Aug 02 23:26:34 user nova-compute[72520]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 02 23:26:37 user nova-compute[72520]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72520) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72520) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72520) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 02 23:26:37 user nova-compute[72520]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:26:37 user nova-compute[72520]: INFO nova.virt.driver [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 02 23:26:37 user nova-compute[72520]: INFO nova.compute.provider_config [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Acquiring lock "singleton_lock" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Acquired lock "singleton_lock" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Releasing lock "singleton_lock" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Full set of CONF: {{(pid=72520) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ******************************************************************************** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Configuration options gathered from: {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ================================================================================ {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] allow_resize_to_same_host      = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] arq_binding_timeout            = 300 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] backdoor_port                  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] backdoor_socket                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] block_device_allocate_retries  = 300 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] block_device_allocate_retries_interval = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cert                           = self.pem {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute_monitors               = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] config_dir                     = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] config_drive_format            = iso9660 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] config_source                  = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] console_host                   = user {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] control_exchange               = nova {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cpu_allocation_ratio           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] daemon                         = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] debug                          = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] default_access_ip_network_name = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] default_availability_zone      = nova {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] default_ephemeral_format       = ext4 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] default_schedule_zone          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] disk_allocation_ratio          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] enable_new_services            = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] enabled_ssl_apis               = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] flat_injected                  = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] force_config_drive             = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] force_raw_images               = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] graceful_shutdown_timeout      = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] heal_instance_info_cache_interval = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] host                           = user {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instance_build_timeout         = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instance_delete_interval       = 300 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instance_name_template         = instance-%08x {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instance_usage_audit           = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instance_usage_audit_period    = month {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] internal_service_availability_zone = internal {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] key                            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] live_migration_retry_count     = 30 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_config_append              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_dir                        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_file                       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_options                    = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_rotate_interval            = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_rotate_interval_type       = days {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] log_rotation_type              = none {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] long_rpc_timeout               = 1800 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] max_concurrent_builds          = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] max_concurrent_live_migrations = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] max_concurrent_snapshots       = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] max_local_block_devices        = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] max_logfile_count              = 30 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] max_logfile_size_mb            = 200 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] maximum_instance_delete_attempts = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] metadata_listen                = 0.0.0.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] metadata_listen_port           = 8775 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] metadata_workers               = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] migrate_max_retries            = -1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] mkisofs_cmd                    = genisoimage {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] my_ip                          = 10.0.0.210 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] network_allocate_retries       = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] osapi_compute_listen_port      = 8774 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] osapi_compute_unique_server_name_scope =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] osapi_compute_workers          = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] password_length                = 12 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] periodic_enable                = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] periodic_fuzzy_delay           = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] pointer_model                  = ps2mouse {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] preallocate_images             = none {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] publish_errors                 = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] pybasedir                      = /opt/stack/nova {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ram_allocation_ratio           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rate_limit_burst               = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rate_limit_except_level        = CRITICAL {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rate_limit_interval            = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] reboot_timeout                 = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] reclaim_instance_interval      = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] record                         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] reimage_timeout_per_gb         = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] report_interval                = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rescue_timeout                 = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] reserved_host_cpus             = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] reserved_host_disk_mb          = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] reserved_host_memory_mb        = 512 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] reserved_huge_pages            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] resize_confirm_window          = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] resize_fs_using_block_device   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] resume_guests_state_on_host_boot = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rpc_response_timeout           = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] run_external_periodic_tasks    = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] running_deleted_instance_action = reap {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] running_deleted_instance_timeout = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler_instance_sync_interval = 120 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_down_time              = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] servicegroup_driver            = db {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] shelved_offload_time           = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] shelved_poll_interval          = 3600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] shutdown_timeout               = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] source_is_ipv6                 = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ssl_only                       = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] state_path                     = /opt/stack/data/nova {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] sync_power_state_interval      = 600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] sync_power_state_pool_size     = 1000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] syslog_log_facility            = LOG_USER {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] tempdir                        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] timeout_nbd                    = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] transport_url                  = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] update_resources_interval      = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] use_cow_images                 = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] use_eventlog                   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] use_journal                    = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] use_json                       = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] use_rootwrap_daemon            = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] use_stderr                     = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] use_syslog                     = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vcpu_pin_set                   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plugging_is_fatal          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plugging_timeout           = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] virt_mkfs                      = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] volume_usage_poll_interval     = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] watch_log_file                 = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] web                            = /usr/share/spice-html5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_concurrency.disable_process_locking = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.auth_strategy              = keystone {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.compute_link_prefix        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.dhcp_domain                = novalocal {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.enable_instance_password   = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.glance_link_prefix         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.instance_list_per_project_cells = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.list_records_by_skipping_down_cells = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.local_metadata_per_cell    = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.max_limit                  = 1000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.metadata_cache_expiration  = 15 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.neutron_default_tenant_id  = default {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.use_forwarded_for          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.use_neutron_default_nets   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.vendordata_dynamic_targets = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.vendordata_jsonfile_path   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.backend_argument         = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.config_prefix            = cache.oslo {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.dead_timeout             = 60.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.debug_cache_backend      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.enable_retry_client      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.enable_socket_keepalive  = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.enabled                  = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.expiration_time          = 600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.hashclient_retry_attempts = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_dead_retry      = 300 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_password        =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_sasl_enabled    = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.memcache_username        =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.proxies                  = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.retry_attempts           = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.retry_delay              = 0.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.socket_keepalive_count   = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.socket_keepalive_idle    = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.socket_keepalive_interval = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.tls_allowed_ciphers      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.tls_cafile               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.tls_certfile             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.tls_enabled              = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cache.tls_keyfile              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.auth_section            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.auth_type               = password {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.cafile                  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.certfile                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.collect_timing          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.cross_az_attach         = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.debug                   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.endpoint_template       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.http_retries            = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.insecure                = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.keyfile                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.os_region_name          = RegionOne {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.split_loggers           = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cinder.timeout                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.cpu_dedicated_set      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.cpu_shared_set         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.image_type_exclude_list = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.resource_provider_association_refresh = 300 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.shutdown_retry_interval = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] conductor.workers              = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] console.allowed_origins        = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] console.ssl_ciphers            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] console.ssl_minimum_version    = default {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] consoleauth.token_ttl          = 600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.cafile                  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.certfile                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.collect_timing          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.connect_retries         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.connect_retry_delay     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.endpoint_override       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.insecure                = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.keyfile                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.max_version             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.min_version             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.region_name             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.service_name            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.service_type            = accelerator {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.split_loggers           = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.status_code_retries     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.status_code_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.timeout                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] cyborg.version                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.backend               = sqlalchemy {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.connection            = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.connection_debug      = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.connection_parameters =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.connection_recycle_time = 3600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.connection_trace      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.db_inc_retry_interval = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.db_max_retries        = 20 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.db_max_retry_interval = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.db_retry_interval     = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.max_overflow          = 50 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.max_pool_size         = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.max_retries           = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.mysql_enable_ndb      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.mysql_wsrep_sync_wait = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.pool_timeout          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.retry_interval        = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.slave_connection      = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] database.sqlite_synchronous    = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.backend           = sqlalchemy {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.connection        = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.connection_debug  = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.connection_parameters =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.connection_recycle_time = 3600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.connection_trace  = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.db_inc_retry_interval = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.db_max_retries    = 20 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.db_max_retry_interval = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.db_retry_interval = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.max_overflow      = 50 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.max_pool_size     = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.max_retries       = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.mysql_enable_ndb  = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.pool_timeout      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.retry_interval    = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.slave_connection  = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] api_database.sqlite_synchronous = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] devices.enabled_mdev_types     = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ephemeral_storage_encryption.enabled = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.api_servers             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.cafile                  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.certfile                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.collect_timing          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.connect_retries         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.connect_retry_delay     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.debug                   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.default_trusted_certificate_ids = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.enable_certificate_validation = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.enable_rbd_download     = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.endpoint_override       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.insecure                = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.keyfile                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.max_version             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.min_version             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.num_retries             = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.rbd_ceph_conf           =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.rbd_connect_timeout     = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.rbd_pool                =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.rbd_user                =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.region_name             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.service_name            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.service_type            = image {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.split_loggers           = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.status_code_retries     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.status_code_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.timeout                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.verify_glance_signatures = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] glance.version                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] guestfs.debug                  = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.config_drive_cdrom      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.config_drive_inject_password = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.enable_remotefx         = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.instances_path_share    =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.limit_cpu_features      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.use_multipath_io        = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.vswitch_name            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] mks.enabled                    = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] image_cache.manager_interval   = 2400 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] image_cache.precache_concurrency = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] image_cache.remove_unused_base_images = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] image_cache.subdirectory_name  = _base {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.api_max_retries         = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.api_retry_interval      = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.auth_section            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.auth_type               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.cafile                  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.certfile                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.collect_timing          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.connect_retries         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.connect_retry_delay     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.endpoint_override       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.insecure                = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.keyfile                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.max_version             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.min_version             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.partition_key           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.peer_list               = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.region_name             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.serial_console_state_timeout = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.service_name            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.service_type            = baremetal {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.split_loggers           = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.status_code_retries     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.status_code_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.timeout                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ironic.version                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] key_manager.fixed_key          = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.barbican_api_version  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.barbican_endpoint     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.barbican_endpoint_type = public {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.barbican_region_name  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.cafile                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.certfile              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.collect_timing        = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.insecure              = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.keyfile               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.number_of_retries     = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.retry_delay           = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.send_service_user_token = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.split_loggers         = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.timeout               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.verify_ssl            = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican.verify_ssl_path       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.auth_section = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.auth_type = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.cafile   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.certfile = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.collect_timing = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.insecure = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.keyfile  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.split_loggers = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] barbican_service_user.timeout  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.approle_role_id          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.approle_secret_id        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.cafile                   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.certfile                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.collect_timing           = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.insecure                 = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.keyfile                  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.kv_mountpoint            = secret {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.kv_version               = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.namespace                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.root_token_id            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.split_loggers            = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.ssl_ca_crt_file          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.timeout                  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.use_ssl                  = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.cafile                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.certfile              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.collect_timing        = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.connect_retries       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.connect_retry_delay   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.endpoint_override     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.insecure              = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.keyfile               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.max_version           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.min_version           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.region_name           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.service_name          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.service_type          = identity {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.split_loggers         = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.status_code_retries   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.status_code_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.timeout               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] keystone.version               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.connection_uri         =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.cpu_mode               = custom {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: WARNING oslo_config.cfg [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.cpu_power_governor_high = performance {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.cpu_power_management   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.device_detach_attempts = 8 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.device_detach_timeout  = 20 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.disk_cachemodes        = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.disk_prefix            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.enabled_perf_events    = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.file_backed_memory     = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.gid_maps               = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.hw_disk_discard        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.hw_machine_type        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.images_rbd_pool        = rbd {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.images_type            = default {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.images_volume_group    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.inject_key             = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.inject_partition       = -2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.inject_password        = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.iscsi_iface            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.iser_use_multipath     = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_downtime = 500 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_inbound_addr = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_scheme  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_timeout_action = abort {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_tunnelled = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: WARNING oslo_config.cfg [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 02 23:26:37 user nova-compute[72520]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 02 23:26:37 user nova-compute[72520]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 02 23:26:37 user nova-compute[72520]: and ``live_migration_inbound_addr`` respectively.
Aug 02 23:26:37 user nova-compute[72520]: ).  Its value may be silently ignored in the future.
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.live_migration_with_native_tls = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.max_queues             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.nfs_mount_options      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.num_pcie_ports         = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.pmem_namespaces        = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.quobyte_client_cfg     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rbd_secret_uuid        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rbd_user               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rescue_image_id        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rescue_kernel_id       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.rx_queue_size          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.smbfs_mount_options    =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.snapshot_compression   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.snapshot_image_format  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.sparse_logical_volumes = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.swtpm_enabled          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.swtpm_group            = tss {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.swtpm_user             = tss {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.sysinfo_serial         = unique {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.tb_cache_size          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.tx_queue_size          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.uid_maps               = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.use_virtio_for_bridges = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.virt_type              = kvm {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.volume_clear           = zero {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.volume_clear_size      = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.volume_use_multipath   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.vzstorage_cache_path   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.auth_section           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.auth_type              = password {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.cafile                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.certfile               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.collect_timing         = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.connect_retries        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.connect_retry_delay    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.default_floating_pool  = public {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.endpoint_override      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.extension_sync_interval = 600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.http_retries           = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.insecure               = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.keyfile                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.max_version            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.min_version            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.ovs_bridge             = br-int {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.physnets               = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.region_name            = RegionOne {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.service_metadata_proxy = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.service_name           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.service_type           = network {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.split_loggers          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.status_code_retries    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.status_code_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.timeout                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] neutron.version                = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] notifications.bdms_in_notifications = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] notifications.default_level    = INFO {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] notifications.notification_format = unversioned {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] notifications.notify_on_state_change = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] pci.alias                      = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] pci.device_spec                = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] pci.report_in_placement        = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.auth_section         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.auth_type            = password {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.cafile               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.certfile             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.collect_timing       = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.connect_retries      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.connect_retry_delay  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.default_domain_id    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.default_domain_name  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.domain_id            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.domain_name          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.endpoint_override    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.insecure             = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.keyfile              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.max_version          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.min_version          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.password             = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.project_domain_id    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.project_domain_name  = Default {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.project_id           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.project_name         = service {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.region_name          = RegionOne {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.service_name         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.service_type         = placement {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.split_loggers        = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.status_code_retries  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.status_code_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.system_scope         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.timeout              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.trust_id             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.user_domain_id       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.user_domain_name     = Default {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.user_id              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.username             = placement {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] placement.version              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.cores                    = 20 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.count_usage_from_placement = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.injected_file_content_bytes = 10240 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.injected_file_path_length = 255 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.injected_files           = 5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.instances                = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.key_pairs                = 100 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.metadata_items           = 128 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.ram                      = 51200 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.recheck_quota            = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.server_group_members     = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] quota.server_groups            = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rdp.enabled                    = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.image_metadata_prefilter = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.max_attempts         = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.max_placement_results = 1000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] scheduler.workers              = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.host_subset_size = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.isolated_hosts = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.isolated_images = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.pci_in_placement = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.track_instance_changes = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] metrics.required               = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] metrics.weight_multiplier      = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] metrics.weight_setting         = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] serial_console.enabled         = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] serial_console.port_range      = 10000:20000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] serial_console.serialproxy_port = 6083 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.auth_section      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.auth_type         = password {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.cafile            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.certfile          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.collect_timing    = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.insecure          = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.keyfile           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.send_service_user_token = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.split_loggers     = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] service_user.timeout           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.agent_enabled            = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.enabled                  = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.html5proxy_port          = 6082 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.image_compression        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.jpeg_compression         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.playback_compression     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.server_listen            = 127.0.0.1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.streaming_mode           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] spice.zlib_compression         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] upgrade_levels.baseapi         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] upgrade_levels.cert            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] upgrade_levels.compute         = auto {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] upgrade_levels.conductor       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] upgrade_levels.scheduler       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.cafile = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.certfile = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.insecure = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vendordata_dynamic_auth.timeout = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.api_retry_count         = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.ca_file                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.cache_prefix            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.cluster_name            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.connection_pool_size    = 10 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.console_delay_seconds   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.datastore_regex         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.host_ip                 = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.host_password           = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.host_port               = 443 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.host_username           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.insecure                = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.integration_bridge      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.maximum_objects         = 100 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.pbm_default_policy      = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.pbm_enabled             = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.pbm_wsdl_location       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.serial_port_proxy_uri   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.serial_port_service_uri = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.task_poll_interval      = 0.5 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.use_linked_clone        = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.vnc_keymap              = en-us {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.vnc_port                = 5900 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vmware.vnc_port_total          = 10000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.auth_schemes               = ['none'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.enabled                    = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.novncproxy_port            = 6080 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.vencrypt_ca_certs          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.vencrypt_client_cert       = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vnc.vencrypt_client_key        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.disable_rootwrap   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.enable_numa_live_migration = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.libvirt_disable_apic = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.client_socket_timeout     = 900 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.default_pool_size         = 1000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.keep_alive                = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.max_header_line           = 16384 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.ssl_ca_file               = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.ssl_cert_file             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.ssl_key_file              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.tcp_keepidle              = 600 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] zvm.ca_file                    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] zvm.cloud_connector_url        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] zvm.reachable_timeout          = 300 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.enforce_new_defaults = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.enforce_scope      = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.policy_default_rule = default {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.connection_string     = messaging:// {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.enabled               = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.es_doc_type           = notification {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.es_scroll_size        = 10000 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.es_scroll_time        = 2m {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.filter_error_trace    = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.hmac_keys             = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.sentinel_service_name = mymaster {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.socket_timeout        = 0.1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.trace_requests        = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler.trace_sqlalchemy      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler_jaeger.process_tags   = {} {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler_jaeger.service_name_prefix = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] profiler_otlp.service_name_prefix = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] remote_debug.host              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] remote_debug.port              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_notifications.retry = -1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.auth_section        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.auth_type           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.cafile              = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.certfile            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.collect_timing      = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.connect_retries     = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.connect_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.endpoint_id         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.endpoint_override   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.insecure            = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.keyfile             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.max_version         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.min_version         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.region_name         = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.service_name        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.service_type        = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.split_loggers       = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.status_code_retries = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.status_code_retry_delay = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.timeout             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.valid_interfaces    = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_limit.version             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_reports.file_event_handler = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] oslo_reports.log_dir           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_ovs_privileged.group  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] vif_plug_ovs_privileged.user   = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_ovs.isolate_vif         = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] os_brick.lock_path             = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] privsep_osbrick.capabilities   = [21] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] privsep_osbrick.group          = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] privsep_osbrick.helper_command = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] privsep_osbrick.user           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] nova_sys_admin.group           = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] nova_sys_admin.helper_command  = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] nova_sys_admin.user            = None {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 02 23:26:37 user nova-compute[72520]: DEBUG oslo_service.service [None req-3633295c-476d-4906-ae72-533cd0cbd157 None None] ******************************************************************************** {{(pid=72520) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 02 23:26:37 user nova-compute[72520]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 02 23:26:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Starting native event thread {{(pid=72520) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 02 23:26:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Starting green dispatch thread {{(pid=72520) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 02 23:26:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Starting connection event dispatch thread {{(pid=72520) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 02 23:26:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Connecting to libvirt: qemu:///system {{(pid=72520) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 02 23:26:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7d064f4ac0> {{(pid=72520) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 02 23:26:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7d064f4ac0> {{(pid=72520) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 02 23:26:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Connection event '1' reason 'None'
Aug 02 23:26:38 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 02 23:26:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.mount [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Initialising _HostMountState generation 0 {{(pid=72520) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 02 23:26:45 user nova-compute[72520]: INFO nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host capabilities <capabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <host>
Aug 02 23:26:45 user nova-compute[72520]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 02 23:26:45 user nova-compute[72520]:     <cpu>
Aug 02 23:26:45 user nova-compute[72520]:       <arch>x86_64</arch>
Aug 02 23:26:45 user nova-compute[72520]:       <model>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <microcode version='1070'/>
Aug 02 23:26:45 user nova-compute[72520]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 02 23:26:45 user nova-compute[72520]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='osxsave'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='invtsc'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='rsba'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature name='skip-l1dfl-vmentry'/>
Aug 02 23:26:45 user nova-compute[72520]:       <pages unit='KiB' size='4'/>
Aug 02 23:26:45 user nova-compute[72520]:       <pages unit='KiB' size='2048'/>
Aug 02 23:26:45 user nova-compute[72520]:     </cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <power_management>
Aug 02 23:26:45 user nova-compute[72520]:       <suspend_mem/>
Aug 02 23:26:45 user nova-compute[72520]:       <suspend_disk/>
Aug 02 23:26:45 user nova-compute[72520]:       <suspend_hybrid/>
Aug 02 23:26:45 user nova-compute[72520]:     </power_management>
Aug 02 23:26:45 user nova-compute[72520]:     <iommu support='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <migration_features>
Aug 02 23:26:45 user nova-compute[72520]:       <live/>
Aug 02 23:26:45 user nova-compute[72520]:       <uri_transports>
Aug 02 23:26:45 user nova-compute[72520]:         <uri_transport>tcp</uri_transport>
Aug 02 23:26:45 user nova-compute[72520]:         <uri_transport>rdma</uri_transport>
Aug 02 23:26:45 user nova-compute[72520]:       </uri_transports>
Aug 02 23:26:45 user nova-compute[72520]:     </migration_features>
Aug 02 23:26:45 user nova-compute[72520]:     <topology>
Aug 02 23:26:45 user nova-compute[72520]:       <cells num='2'>
Aug 02 23:26:45 user nova-compute[72520]:         <cell id='0'>
Aug 02 23:26:45 user nova-compute[72520]:           <memory unit='KiB'>8140616</memory>
Aug 02 23:26:45 user nova-compute[72520]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 02 23:26:45 user nova-compute[72520]:           <pages unit='KiB' size='2048'>0</pages>
Aug 02 23:26:45 user nova-compute[72520]:           <distances>
Aug 02 23:26:45 user nova-compute[72520]:             <sibling id='0' value='10'/>
Aug 02 23:26:45 user nova-compute[72520]:             <sibling id='1' value='20'/>
Aug 02 23:26:45 user nova-compute[72520]:           </distances>
Aug 02 23:26:45 user nova-compute[72520]:           <cpus num='6'>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 02 23:26:45 user nova-compute[72520]:           </cpus>
Aug 02 23:26:45 user nova-compute[72520]:         </cell>
Aug 02 23:26:45 user nova-compute[72520]:         <cell id='1'>
Aug 02 23:26:45 user nova-compute[72520]:           <memory unit='KiB'>8255068</memory>
Aug 02 23:26:45 user nova-compute[72520]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 02 23:26:45 user nova-compute[72520]:           <pages unit='KiB' size='2048'>0</pages>
Aug 02 23:26:45 user nova-compute[72520]:           <distances>
Aug 02 23:26:45 user nova-compute[72520]:             <sibling id='0' value='20'/>
Aug 02 23:26:45 user nova-compute[72520]:             <sibling id='1' value='10'/>
Aug 02 23:26:45 user nova-compute[72520]:           </distances>
Aug 02 23:26:45 user nova-compute[72520]:           <cpus num='6'>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 02 23:26:45 user nova-compute[72520]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 02 23:26:45 user nova-compute[72520]:           </cpus>
Aug 02 23:26:45 user nova-compute[72520]:         </cell>
Aug 02 23:26:45 user nova-compute[72520]:       </cells>
Aug 02 23:26:45 user nova-compute[72520]:     </topology>
Aug 02 23:26:45 user nova-compute[72520]:     <cache>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 02 23:26:45 user nova-compute[72520]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 02 23:26:45 user nova-compute[72520]:     </cache>
Aug 02 23:26:45 user nova-compute[72520]:     <secmodel>
Aug 02 23:26:45 user nova-compute[72520]:       <model>apparmor</model>
Aug 02 23:26:45 user nova-compute[72520]:       <doi>0</doi>
Aug 02 23:26:45 user nova-compute[72520]:     </secmodel>
Aug 02 23:26:45 user nova-compute[72520]:     <secmodel>
Aug 02 23:26:45 user nova-compute[72520]:       <model>dac</model>
Aug 02 23:26:45 user nova-compute[72520]:       <doi>0</doi>
Aug 02 23:26:45 user nova-compute[72520]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 02 23:26:45 user nova-compute[72520]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 02 23:26:45 user nova-compute[72520]:     </secmodel>
Aug 02 23:26:45 user nova-compute[72520]:   </host>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='alpha'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>clipper</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='armv6l'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>integratorcp</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>borzoi</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>spitz</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>nuri</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>musca-b1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>versatileab</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>kzm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>musca-a</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>smdkc210</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sx1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>z2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>tosa</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>sabrelite</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>realview-eb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>n810</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>n800</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>versatilepb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>terrier</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mainstone</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>midway</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>musicpal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>microbit</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>cubieboard</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>verdex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>netduino2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>raspi2b</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>cheetah</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>highbank</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>akita</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>connex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>collie</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>raspi0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='armv7l'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>integratorcp</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>borzoi</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>spitz</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>nuri</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>musca-b1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>versatileab</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>kzm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>musca-a</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>smdkc210</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sx1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>z2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>tosa</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>sabrelite</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>realview-eb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>n810</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>n800</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>versatilepb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>terrier</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mainstone</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>midway</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>musicpal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>microbit</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>cubieboard</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>verdex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>netduino2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>raspi2b</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>cheetah</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>highbank</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>akita</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>connex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>collie</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>raspi0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='aarch64'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>integratorcp</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>borzoi</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>spitz</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>nuri</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>musca-b1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>versatileab</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>kzm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>musca-a</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>smdkc210</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sx1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>z2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>tosa</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>sabrelite</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>realview-eb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>n810</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>n800</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>versatilepb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>terrier</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mainstone</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>midway</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>musicpal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>microbit</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>cubieboard</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>verdex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>netduino2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>raspi3b</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>raspi2b</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>cheetah</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>highbank</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>akita</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>connex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>collie</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>raspi0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <acpi default='on' toggle='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='cris'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='i686'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>x-remote</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>isapc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>microvm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='kvm'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <pae/>
Aug 02 23:26:45 user nova-compute[72520]:       <nonpae/>
Aug 02 23:26:45 user nova-compute[72520]:       <acpi default='on' toggle='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:       <apic default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='m68k'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>an5206</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>q800</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>next-cube</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='microblaze'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='microblazeel'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='mips'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='16'>malta</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mipssim</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='mipsel'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='16'>malta</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mipssim</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='mips64'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='16'>malta</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mipssim</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>pica61</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>magnum</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='mips64el'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='16'>malta</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mipssim</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>pica61</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>magnum</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='16'>boston</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='ppc'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>g3beige</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mac99</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>ppce500</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>pegasos2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sam460ex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>bamboo</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>40p</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>ref405ep</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>taihu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='ppc64'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2048'>powernv9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>taihu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2048'>powernv10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>ppce500</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>40p</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>pegasos2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>bamboo</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>g3beige</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mac99</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sam460ex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>ref405ep</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2048'>powernv8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='ppc64le'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2048'>powernv9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>taihu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2048'>powernv10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>ppce500</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>40p</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>pegasos2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>bamboo</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>g3beige</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>mac99</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sam460ex</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>ref405ep</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2048'>powernv8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='riscv32'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='8'>spike</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>opentitan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='5'>sifive_u</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sifive_e</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='8'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='riscv64'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='8'>spike</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='5'>sifive_u</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>shakti_c</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sifive_e</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='8'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='s390x'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='sh4'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>shix</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>r2d</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='sh4eb'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>shix</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>r2d</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='sparc'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>SS-5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>SS-20</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>LX</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>SS-4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>SS-10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>Voyager</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='sparc64'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sun4u</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>niagara</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>sun4v</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='x86_64'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>64</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>x-remote</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='1'>isapc</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>microvm</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='kvm'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <acpi default='on' toggle='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:       <apic default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='xtensa'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>sim</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>kc705</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>ml605</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx200</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx60</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]:   <guest>
Aug 02 23:26:45 user nova-compute[72520]:     <os_type>hvm</os_type>
Aug 02 23:26:45 user nova-compute[72520]:     <arch name='xtensaeb'>
Aug 02 23:26:45 user nova-compute[72520]:       <wordsize>32</wordsize>
Aug 02 23:26:45 user nova-compute[72520]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='4'>sim</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>kc705</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>ml605</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>virt</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx200</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>lx60</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 02 23:26:45 user nova-compute[72520]:       <domain type='qemu'/>
Aug 02 23:26:45 user nova-compute[72520]:     </arch>
Aug 02 23:26:45 user nova-compute[72520]:     <features>
Aug 02 23:26:45 user nova-compute[72520]:       <cpuselection/>
Aug 02 23:26:45 user nova-compute[72520]:       <deviceboot/>
Aug 02 23:26:45 user nova-compute[72520]:       <disksnapshot default='on' toggle='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     </features>
Aug 02 23:26:45 user nova-compute[72520]:   </guest>
Aug 02 23:26:45 user nova-compute[72520]: </capabilities>
Aug 02 23:26:45 user nova-compute[72520]: 
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-q35-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>i686</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='288'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'/>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='lm'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-i440fx-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>i686</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='255'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'/>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='lm'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ide</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-q35-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>i686</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='288'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'/>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='lm'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-i440fx-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>i686</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='255'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'/>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='lm'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ide</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-q35-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>x86_64</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='288'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>efi</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='invtsc'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='rsba'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-i440fx-6.2</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>x86_64</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='255'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>efi</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='invtsc'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='rsba'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ide</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-q35-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>x86_64</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='288'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>efi</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='invtsc'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='rsba'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 02 23:26:45 user nova-compute[72520]: <domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 02 23:26:45 user nova-compute[72520]:   <domain>kvm</domain>
Aug 02 23:26:45 user nova-compute[72520]:   <machine>pc-i440fx-jammy</machine>
Aug 02 23:26:45 user nova-compute[72520]:   <arch>x86_64</arch>
Aug 02 23:26:45 user nova-compute[72520]:   <vcpu max='255'/>
Aug 02 23:26:45 user nova-compute[72520]:   <iothreads supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:   <os supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='firmware'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>efi</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:     <loader supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>rom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pflash</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='readonly'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>yes</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='secure'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>no</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </loader>
Aug 02 23:26:45 user nova-compute[72520]:   </os>
Aug 02 23:26:45 user nova-compute[72520]:   <cpu>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-passthrough' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='hostPassthroughMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='maximum' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='maximumMigratable'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>on</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>off</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='host-model' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <vendor>Intel</vendor>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ss'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='vmx'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pcid'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='hypervisor'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arat'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='tsc_adjust'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='umip'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='md-clear'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='arch-capabilities'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='invtsc'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibpb'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='ibrs'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-stibp'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='amd-ssbd'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='rsba'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='erms'/>
Aug 02 23:26:45 user nova-compute[72520]:       <feature policy='disable' name='xsaveopt'/>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:     <mode name='custom' supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>qemu64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>qemu32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>phenom</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>pentium</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>n270</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm64</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>kvm32</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>coreduo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>core2duo</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>athlon</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Westmere</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Snowridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Skylake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>SandyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Penryn</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G5</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G4</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G3</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Opteron_G2</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Opteron_G1</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>IvyBridge</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Icelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Haswell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Rome</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-Milan</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC-IBPB</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>EPYC</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Dhyana</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cooperlake</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>Conroe</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Cascadelake-Server</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='no'>Broadwell</model>
Aug 02 23:26:45 user nova-compute[72520]:       <model usable='yes'>486</model>
Aug 02 23:26:45 user nova-compute[72520]:     </mode>
Aug 02 23:26:45 user nova-compute[72520]:   </cpu>
Aug 02 23:26:45 user nova-compute[72520]:   <memoryBacking supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:     <enum name='sourceType'>
Aug 02 23:26:45 user nova-compute[72520]:       <value>file</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>anonymous</value>
Aug 02 23:26:45 user nova-compute[72520]:       <value>memfd</value>
Aug 02 23:26:45 user nova-compute[72520]:     </enum>
Aug 02 23:26:45 user nova-compute[72520]:   </memoryBacking>
Aug 02 23:26:45 user nova-compute[72520]:   <devices>
Aug 02 23:26:45 user nova-compute[72520]:     <disk supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='diskDevice'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>disk</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cdrom</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>floppy</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>lun</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='bus'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ide</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>fdc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sata</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </disk>
Aug 02 23:26:45 user nova-compute[72520]:     <graphics supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='type'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>sdl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vnc</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>spice</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egl-headless</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </graphics>
Aug 02 23:26:45 user nova-compute[72520]:     <video supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='modelType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>cirrus</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>vmvga</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>qxl</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>none</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>bochs</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>ramfb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </video>
Aug 02 23:26:45 user nova-compute[72520]:     <hostdev supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='mode'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>subsystem</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='startupPolicy'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>default</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>mandatory</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>requisite</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>optional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='subsysType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>usb</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>pci</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>scsi</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='capsType'/>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='pciBackend'/>
Aug 02 23:26:45 user nova-compute[72520]:     </hostdev>
Aug 02 23:26:45 user nova-compute[72520]:     <rng supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtio-non-transitional</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>random</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>egd</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>builtin</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </rng>
Aug 02 23:26:45 user nova-compute[72520]:     <filesystem supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='driverType'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>path</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>handle</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>virtiofs</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </filesystem>
Aug 02 23:26:45 user nova-compute[72520]:     <tpm supported='yes'>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='model'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-tis</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>tpm-crb</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:       <enum name='backendModel'>
Aug 02 23:26:45 user nova-compute[72520]:         <value>passthrough</value>
Aug 02 23:26:45 user nova-compute[72520]:         <value>emulator</value>
Aug 02 23:26:45 user nova-compute[72520]:       </enum>
Aug 02 23:26:45 user nova-compute[72520]:     </tpm>
Aug 02 23:26:45 user nova-compute[72520]:   </devices>
Aug 02 23:26:45 user nova-compute[72520]:   <features>
Aug 02 23:26:45 user nova-compute[72520]:     <gic supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:     <vmcoreinfo supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <genid supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backingStoreInput supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <backup supported='yes'/>
Aug 02 23:26:45 user nova-compute[72520]:     <sev supported='no'/>
Aug 02 23:26:45 user nova-compute[72520]:   </features>
Aug 02 23:26:45 user nova-compute[72520]: </domainCapabilities>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Checking secure boot support for host arch (x86_64) {{(pid=72520) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 02 23:26:45 user nova-compute[72520]: INFO nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Secure Boot support detected
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] cpu compare xml: <cpu match="exact">
Aug 02 23:26:45 user nova-compute[72520]:   <model>Nehalem</model>
Aug 02 23:26:45 user nova-compute[72520]: </cpu>
Aug 02 23:26:45 user nova-compute[72520]:  {{(pid=72520) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 02 23:26:45 user nova-compute[72520]: INFO nova.virt.node [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Generated node identity 34a01f3b-1fb2-4503-8766-a057bea6ed6a
Aug 02 23:26:45 user nova-compute[72520]: INFO nova.virt.node [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Wrote node identity 34a01f3b-1fb2-4503-8766-a057bea6ed6a to /opt/stack/data/nova/compute_id
Aug 02 23:26:45 user nova-compute[72520]: WARNING nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Compute nodes ['34a01f3b-1fb2-4503-8766-a057bea6ed6a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 02 23:26:45 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 02 23:26:45 user nova-compute[72520]: WARNING nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 02 23:26:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:26:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:26:46 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:26:46 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Hypervisor/Node resource view: name=user free_ram=10939MB free_disk=26.343585968017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:26:46 user nova-compute[72520]: WARNING nova.compute.resource_tracker [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] No compute node record for user:34a01f3b-1fb2-4503-8766-a057bea6ed6a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 34a01f3b-1fb2-4503-8766-a057bea6ed6a could not be found.
Aug 02 23:26:46 user nova-compute[72520]: INFO nova.compute.resource_tracker [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Compute node record created for user:user with uuid: 34a01f3b-1fb2-4503-8766-a057bea6ed6a
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:26:46 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [req-60d4e806-6673-4671-a133-d7bf9a1131da] Created resource provider record via placement API for resource provider with UUID 34a01f3b-1fb2-4503-8766-a057bea6ed6a and name user.
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72520) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 02 23:26:46 user nova-compute[72520]: INFO nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] kernel doesn't support AMD SEV
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Libvirt baseline CPU <cpu>
Aug 02 23:26:46 user nova-compute[72520]:   <arch>x86_64</arch>
Aug 02 23:26:46 user nova-compute[72520]:   <model>Nehalem</model>
Aug 02 23:26:46 user nova-compute[72520]:   <vendor>Intel</vendor>
Aug 02 23:26:46 user nova-compute[72520]:   <topology sockets="6" cores="1" threads="1"/>
Aug 02 23:26:46 user nova-compute[72520]: </cpu>
Aug 02 23:26:46 user nova-compute[72520]:  {{(pid=72520) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Updated inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Updating resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a generation from 0 to 1 during operation: update_inventory {{(pid=72520) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Updating resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a generation from 1 to 2 during operation: update_traits {{(pid=72520) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.service [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Creating RPC server for service compute {{(pid=72520) start /opt/stack/nova/nova/service.py:182}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.service [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Join ServiceGroup membership for this service compute {{(pid=72520) start /opt/stack/nova/nova/service.py:199}}
Aug 02 23:26:46 user nova-compute[72520]: DEBUG nova.servicegroup.drivers.db [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72520) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 02 23:27:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:27:37 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:27:37 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=10246MB free_disk=26.247379302978516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:27:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:28:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:28:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:28:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:28:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:28:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:28:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:28:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=10235MB free_disk=26.29198455810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:28:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:29:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:29:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:29:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:29:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:29:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:29:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=10199MB free_disk=26.06643295288086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:29:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:29:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:30:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:30:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:30:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:30:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:30:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=9456MB free_disk=26.088611602783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:30:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:30:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:30:47 user nova-compute[72520]: INFO nova.compute.claims [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Claim successful on node user
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:30:48 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:30:48 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Creating image(s)
Aug 02 23:30:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "/opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "/opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "/opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:48 user nova-compute[72520]: DEBUG nova.policy [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21f7be3a14a34a5f8d6a0ea074202c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6058cf02ac1547599db4ea597f94c59b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:30:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.part --force-share --output=json" returned: 0 in 0.174s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:49 user nova-compute[72520]: DEBUG nova.virt.images [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] bf7ff550-99bb-492f-8b9b-e7b427d12188 was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:30:49 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:30:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.part /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.part /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.converted" returned: 0 in 0.251s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.804s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:50 user nova-compute[72520]: INFO oslo.privsep.daemon [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5_3wwyie/privsep.sock']
Aug 02 23:30:50 user sudo[81646]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5_3wwyie/privsep.sock
Aug 02 23:30:50 user sudo[81646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 02 23:30:51 user nova-compute[72520]: DEBUG nova.network.neutron [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Successfully created port: c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:30:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "8e524afb-4d71-43a5-8b91-4f558c409237" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:30:52 user nova-compute[72520]: INFO nova.compute.claims [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Claim successful on node user
Aug 02 23:30:52 user sudo[81646]: pam_unix(sudo:session): session closed for user root
Aug 02 23:30:52 user nova-compute[72520]: INFO oslo.privsep.daemon [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Spawned new privsep daemon via rootwrap
Aug 02 23:30:52 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 02 23:30:52 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 02 23:30:52 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 02 23:30:52 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81658
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.network.neutron [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:30:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.182s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:30:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Creating image(s)
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "/opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "/opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk 1073741824" returned: 0 in 0.058s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.policy [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c16da763da24854b7921b9e9d6fe59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a3862c26eb4331b72c545cf91e3802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.174s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk 1073741824" returned: 0 in 0.043s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Cannot resize image /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lazy-loading 'migration_context' on Instance uuid c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Ensure instance console log exists: /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Cannot resize image /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'migration_context' on Instance uuid 8e524afb-4d71-43a5-8b91-4f558c409237 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Ensure instance console log exists: /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:30:54 user nova-compute[72520]: INFO nova.compute.claims [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Claim successful on node user
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Successfully updated port: c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquired lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:30:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:30:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:30:55 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Creating image(s)
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "/opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.policy [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9f79446d734cbfa7644b128bbf5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052da981a9a4629b46fb0d3533c96c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received event network-changed-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Refreshing instance network info cache due to event network-changed-c326c462-dc1c-4bbf-bc2a-9709a9a6548b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] Acquiring lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.161s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk 1073741824" returned: 0 in 0.042s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Successfully created port: 471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Cannot resize image /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.objects.instance [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'migration_context' on Instance uuid b86f31d4-33c5-4b2b-a235-3b07b306f23a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Ensure instance console log exists: /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:30:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.network.neutron [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updating instance_info_cache with network_info: [{"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Releasing lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Instance network_info: |[{"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] Acquired lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.network.neutron [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Refreshing network info cache for port c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Start _get_guest_xml network_info=[{"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:30:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:30:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-276580680',display_name='tempest-DeleteServersTestJSON-server-276580680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-276580680',id=1,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6058cf02ac1547599db4ea597f94c59b',ramdisk_id='',reservation_id='r-04umk4e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1584424782',owner_user_name='tempest-DeleteServersTestJSON-1584424782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:30:48Z,user_data=None,user_id='21f7be3a14a34a5f8d6a0ea074202c7a',uuid=c33c4d73-ca9c-4af8-b38d-b8e51c1ed306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Converting VIF {"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c2:0f,bridge_name='br-int',has_traffic_filtering=True,id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b,network=Network(f9eefe40-46f3-499c-882c-459688aa23eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc326c462-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.objects.instance [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lazy-loading 'pci_devices' on Instance uuid c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:30:56 user nova-compute[72520]:   <uuid>c33c4d73-ca9c-4af8-b38d-b8e51c1ed306</uuid>
Aug 02 23:30:56 user nova-compute[72520]:   <name>instance-00000001</name>
Aug 02 23:30:56 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:30:56 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:30:56 user nova-compute[72520]:   <metadata>
Aug 02 23:30:56 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:30:56 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:30:56 user nova-compute[72520]:       <nova:name>tempest-DeleteServersTestJSON-server-276580680</nova:name>
Aug 02 23:30:56 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:30:56</nova:creationTime>
Aug 02 23:30:56 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:30:56 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:30:56 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:30:56 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:30:56 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:30:56 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:30:56 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:30:56 user nova-compute[72520]:       <nova:owner>
Aug 02 23:30:56 user nova-compute[72520]:         <nova:user uuid="21f7be3a14a34a5f8d6a0ea074202c7a">tempest-DeleteServersTestJSON-1584424782-project-member</nova:user>
Aug 02 23:30:56 user nova-compute[72520]:         <nova:project uuid="6058cf02ac1547599db4ea597f94c59b">tempest-DeleteServersTestJSON-1584424782</nova:project>
Aug 02 23:30:56 user nova-compute[72520]:       </nova:owner>
Aug 02 23:30:56 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:30:56 user nova-compute[72520]:       <nova:ports>
Aug 02 23:30:56 user nova-compute[72520]:         <nova:port uuid="c326c462-dc1c-4bbf-bc2a-9709a9a6548b">
Aug 02 23:30:56 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 02 23:30:56 user nova-compute[72520]:         </nova:port>
Aug 02 23:30:56 user nova-compute[72520]:       </nova:ports>
Aug 02 23:30:56 user nova-compute[72520]:     </nova:instance>
Aug 02 23:30:56 user nova-compute[72520]:   </metadata>
Aug 02 23:30:56 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:30:56 user nova-compute[72520]:     <system>
Aug 02 23:30:56 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:30:56 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:30:56 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:30:56 user nova-compute[72520]:       <entry name="serial">c33c4d73-ca9c-4af8-b38d-b8e51c1ed306</entry>
Aug 02 23:30:56 user nova-compute[72520]:       <entry name="uuid">c33c4d73-ca9c-4af8-b38d-b8e51c1ed306</entry>
Aug 02 23:30:56 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:30:56 user nova-compute[72520]:     </system>
Aug 02 23:30:56 user nova-compute[72520]:   </sysinfo>
Aug 02 23:30:56 user nova-compute[72520]:   <os>
Aug 02 23:30:56 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:30:56 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:30:56 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:30:56 user nova-compute[72520]:   </os>
Aug 02 23:30:56 user nova-compute[72520]:   <features>
Aug 02 23:30:56 user nova-compute[72520]:     <acpi/>
Aug 02 23:30:56 user nova-compute[72520]:     <apic/>
Aug 02 23:30:56 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:30:56 user nova-compute[72520]:   </features>
Aug 02 23:30:56 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:30:56 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:30:56 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:30:56 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:30:56 user nova-compute[72520]:   </clock>
Aug 02 23:30:56 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:30:56 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:30:56 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:30:56 user nova-compute[72520]:   </cpu>
Aug 02 23:30:56 user nova-compute[72520]:   <devices>
Aug 02 23:30:56 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:30:56 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:30:56 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk"/>
Aug 02 23:30:56 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:30:56 user nova-compute[72520]:     </disk>
Aug 02 23:30:56 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:30:56 user nova-compute[72520]:       <mac address="fa:16:3e:4f:c2:0f"/>
Aug 02 23:30:56 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:30:56 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:30:56 user nova-compute[72520]:       <target dev="tapc326c462-dc"/>
Aug 02 23:30:56 user nova-compute[72520]:     </interface>
Aug 02 23:30:56 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:30:56 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/console.log" append="off"/>
Aug 02 23:30:56 user nova-compute[72520]:     </serial>
Aug 02 23:30:56 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:30:56 user nova-compute[72520]:     <video>
Aug 02 23:30:56 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:30:56 user nova-compute[72520]:     </video>
Aug 02 23:30:56 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:30:56 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:30:56 user nova-compute[72520]:     </rng>
Aug 02 23:30:56 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:30:56 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:30:56 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:30:56 user nova-compute[72520]:     </memballoon>
Aug 02 23:30:56 user nova-compute[72520]:   </devices>
Aug 02 23:30:56 user nova-compute[72520]: </domain>
Aug 02 23:30:56 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-276580680',display_name='tempest-DeleteServersTestJSON-server-276580680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-276580680',id=1,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6058cf02ac1547599db4ea597f94c59b',ramdisk_id='',reservation_id='r-04umk4e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1584424782',owner_user_name='tempest-DeleteServersTestJSON-1584424782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:30:48Z,user_data=None,user_id='21f7be3a14a34a5f8d6a0ea074202c7a',uuid=c33c4d73-ca9c-4af8-b38d-b8e51c1ed306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Converting VIF {"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c2:0f,bridge_name='br-int',has_traffic_filtering=True,id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b,network=Network(f9eefe40-46f3-499c-882c-459688aa23eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc326c462-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG os_vif [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c2:0f,bridge_name='br-int',has_traffic_filtering=True,id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b,network=Network(f9eefe40-46f3-499c-882c-459688aa23eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc326c462-dc') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Created schema index Interface.name {{(pid=72520) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Created schema index Port.name {{(pid=72520) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Created schema index Bridge.name {{(pid=72520) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [POLLOUT] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:30:56 user nova-compute[72520]: INFO oslo.privsep.daemon [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkd81r3re/privsep.sock']
Aug 02 23:30:56 user sudo[81717]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkd81r3re/privsep.sock
Aug 02 23:30:56 user sudo[81717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 02 23:30:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Successfully created port: 40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updated VIF entry in instance network info cache for port c326c462-dc1c-4bbf-bc2a-9709a9a6548b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updating instance_info_cache with network_info: [{"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d419d0e6-37d0-4e3b-a2a1-dc7f03fc9f02 req-0414239d-8806-411c-ab58-7c113dad39ec service nova] Releasing lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Successfully updated port: 471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquired lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:30:58 user sudo[81717]: pam_unix(sudo:session): session closed for user root
Aug 02 23:30:58 user nova-compute[72520]: INFO oslo.privsep.daemon [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Spawned new privsep daemon via rootwrap
Aug 02 23:30:58 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 02 23:30:58 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 02 23:30:58 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 02 23:30:58 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81722
Aug 02 23:30:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-changed-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Refreshing instance network info cache due to event network-changed-471151f5-ee67-41d0-817b-333804b86f4e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:30:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] Acquiring lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:30:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:30:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc326c462-dc, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:30:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc326c462-dc, col_values=(('external_ids', {'iface-id': 'c326c462-dc1c-4bbf-bc2a-9709a9a6548b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:c2:0f', 'vm-uuid': 'c33c4d73-ca9c-4af8-b38d-b8e51c1ed306'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:30:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:30:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:30:59 user nova-compute[72520]: INFO os_vif [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c2:0f,bridge_name='br-int',has_traffic_filtering=True,id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b,network=Network(f9eefe40-46f3-499c-882c-459688aa23eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc326c462-dc')
Aug 02 23:30:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:30:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] No VIF found with MAC fa:16:3e:4f:c2:0f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updating instance_info_cache with network_info: [{"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Releasing lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Instance network_info: |[{"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] Acquired lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Refreshing network info cache for port 471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Start _get_guest_xml network_info=[{"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:31:00 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:00 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1733465889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1733465889',id=2,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0t+OeQQsd8/MJGIHmipXsYdugLJQSS1iMQuOWBrl53/qFJZdeb5ydCeFR6arx2NqgbYXH7/Y48dE0GONPrBbaJO2xYXfg3lZw8SNk78hERAHbdfDHS37OYAipuqzsMOw==',key_name='tempest-keypair-1655150030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-r1hdvk0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=8e524afb-4d71-43a5-8b91-4f558c409237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=471151f5-ee67-41d0-817b-333804b86f4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471151f5-ee') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e524afb-4d71-43a5-8b91-4f558c409237 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:31:00 user nova-compute[72520]:   <uuid>8e524afb-4d71-43a5-8b91-4f558c409237</uuid>
Aug 02 23:31:00 user nova-compute[72520]:   <name>instance-00000002</name>
Aug 02 23:31:00 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:31:00 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:31:00 user nova-compute[72520]:   <metadata>
Aug 02 23:31:00 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:31:00 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:31:00 user nova-compute[72520]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1733465889</nova:name>
Aug 02 23:31:00 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:31:00</nova:creationTime>
Aug 02 23:31:00 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:31:00 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:31:00 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:31:00 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:31:00 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:31:00 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:31:00 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:31:00 user nova-compute[72520]:       <nova:owner>
Aug 02 23:31:00 user nova-compute[72520]:         <nova:user uuid="5c16da763da24854b7921b9e9d6fe59e">tempest-ServerActionsV293TestJSON-1063891997-project-member</nova:user>
Aug 02 23:31:00 user nova-compute[72520]:         <nova:project uuid="75a3862c26eb4331b72c545cf91e3802">tempest-ServerActionsV293TestJSON-1063891997</nova:project>
Aug 02 23:31:00 user nova-compute[72520]:       </nova:owner>
Aug 02 23:31:00 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:31:00 user nova-compute[72520]:       <nova:ports>
Aug 02 23:31:00 user nova-compute[72520]:         <nova:port uuid="471151f5-ee67-41d0-817b-333804b86f4e">
Aug 02 23:31:00 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:31:00 user nova-compute[72520]:         </nova:port>
Aug 02 23:31:00 user nova-compute[72520]:       </nova:ports>
Aug 02 23:31:00 user nova-compute[72520]:     </nova:instance>
Aug 02 23:31:00 user nova-compute[72520]:   </metadata>
Aug 02 23:31:00 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:31:00 user nova-compute[72520]:     <system>
Aug 02 23:31:00 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:31:00 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:31:00 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:31:00 user nova-compute[72520]:       <entry name="serial">8e524afb-4d71-43a5-8b91-4f558c409237</entry>
Aug 02 23:31:00 user nova-compute[72520]:       <entry name="uuid">8e524afb-4d71-43a5-8b91-4f558c409237</entry>
Aug 02 23:31:00 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:31:00 user nova-compute[72520]:     </system>
Aug 02 23:31:00 user nova-compute[72520]:   </sysinfo>
Aug 02 23:31:00 user nova-compute[72520]:   <os>
Aug 02 23:31:00 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:31:00 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:31:00 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:31:00 user nova-compute[72520]:   </os>
Aug 02 23:31:00 user nova-compute[72520]:   <features>
Aug 02 23:31:00 user nova-compute[72520]:     <acpi/>
Aug 02 23:31:00 user nova-compute[72520]:     <apic/>
Aug 02 23:31:00 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:31:00 user nova-compute[72520]:   </features>
Aug 02 23:31:00 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:31:00 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:31:00 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:31:00 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:31:00 user nova-compute[72520]:   </clock>
Aug 02 23:31:00 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:31:00 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:31:00 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:31:00 user nova-compute[72520]:   </cpu>
Aug 02 23:31:00 user nova-compute[72520]:   <devices>
Aug 02 23:31:00 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:31:00 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:31:00 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk"/>
Aug 02 23:31:00 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:31:00 user nova-compute[72520]:     </disk>
Aug 02 23:31:00 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:31:00 user nova-compute[72520]:       <mac address="fa:16:3e:71:ac:fd"/>
Aug 02 23:31:00 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:00 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:31:00 user nova-compute[72520]:       <target dev="tap471151f5-ee"/>
Aug 02 23:31:00 user nova-compute[72520]:     </interface>
Aug 02 23:31:00 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:31:00 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/console.log" append="off"/>
Aug 02 23:31:00 user nova-compute[72520]:     </serial>
Aug 02 23:31:00 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:31:00 user nova-compute[72520]:     <video>
Aug 02 23:31:00 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:00 user nova-compute[72520]:     </video>
Aug 02 23:31:00 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:31:00 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:31:00 user nova-compute[72520]:     </rng>
Aug 02 23:31:00 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:31:00 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:31:00 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:31:00 user nova-compute[72520]:     </memballoon>
Aug 02 23:31:00 user nova-compute[72520]:   </devices>
Aug 02 23:31:00 user nova-compute[72520]: </domain>
Aug 02 23:31:00 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1733465889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1733465889',id=2,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0t+OeQQsd8/MJGIHmipXsYdugLJQSS1iMQuOWBrl53/qFJZdeb5ydCeFR6arx2NqgbYXH7/Y48dE0GONPrBbaJO2xYXfg3lZw8SNk78hERAHbdfDHS37OYAipuqzsMOw==',key_name='tempest-keypair-1655150030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-r1hdvk0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=8e524afb-4d71-43a5-8b91-4f558c409237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=471151f5-ee67-41d0-817b-333804b86f4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471151f5-ee') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG os_vif [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=471151f5-ee67-41d0-817b-333804b86f4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471151f5-ee') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471151f5-ee, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap471151f5-ee, col_values=(('external_ids', {'iface-id': '471151f5-ee67-41d0-817b-333804b86f4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ac:fd', 'vm-uuid': '8e524afb-4d71-43a5-8b91-4f558c409237'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:00 user nova-compute[72520]: INFO os_vif [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=471151f5-ee67-41d0-817b-333804b86f4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471151f5-ee')
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] No VIF found with MAC fa:16:3e:71:ac:fd, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Successfully updated port: 40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquired lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-changed-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Refreshing instance network info cache due to event network-changed-40ffeb06-6826-4533-a120-3b8d6b7570b7. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] Acquiring lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.network.neutron [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updated VIF entry in instance network info cache for port 471151f5-ee67-41d0-817b-333804b86f4e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.network.neutron [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updating instance_info_cache with network_info: [{"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-100b9cc0-f1b4-498d-9911-9f61191dd916 req-bbd0bacd-5f4d-43ca-96f8-4994d982e0dc service nova] Releasing lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-91d6c34a-67cc-4a44-beef-a1579cb1b2fa req-e21b2f31-10fe-472e-82bb-920df45eba82 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received event network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91d6c34a-67cc-4a44-beef-a1579cb1b2fa req-e21b2f31-10fe-472e-82bb-920df45eba82 service nova] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91d6c34a-67cc-4a44-beef-a1579cb1b2fa req-e21b2f31-10fe-472e-82bb-920df45eba82 service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91d6c34a-67cc-4a44-beef-a1579cb1b2fa req-e21b2f31-10fe-472e-82bb-920df45eba82 service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-91d6c34a-67cc-4a44-beef-a1579cb1b2fa req-e21b2f31-10fe-472e-82bb-920df45eba82 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] No waiting events found dispatching network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:01 user nova-compute[72520]: WARNING nova.compute.manager [req-91d6c34a-67cc-4a44-beef-a1579cb1b2fa req-e21b2f31-10fe-472e-82bb-920df45eba82 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received unexpected event network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b for instance with vm_state building and task_state spawning.
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.network.neutron [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updating instance_info_cache with network_info: [{"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Releasing lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Instance network_info: |[{"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] Acquired lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.network.neutron [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Refreshing network info cache for port 40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Start _get_guest_xml network_info=[{"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:31:02 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:02 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-279902656',display_name='tempest-AttachVolumeNegativeTest-server-279902656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-279902656',id=3,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn0BZiujVN+LS36VveXKFJEU+CUFYo49Y6/UfcWGZHzXQg9G4hNqytGTtyySdjvukp+epM7mpTcbf+WEuVs61CzN29omP6pBqisxDasn0hF8Yaez/dbi9LkscfoBSki7g==',key_name='tempest-keypair-1147761571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-oq32vyu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=b86f31d4-33c5-4b2b-a235-3b07b306f23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:8b,bridge_name='br-int',has_traffic_filtering=True,id=40ffeb06-6826-4533-a120-3b8d6b7570b7,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ffeb06-68') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'pci_devices' on Instance uuid b86f31d4-33c5-4b2b-a235-3b07b306f23a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:31:02 user nova-compute[72520]:   <uuid>b86f31d4-33c5-4b2b-a235-3b07b306f23a</uuid>
Aug 02 23:31:02 user nova-compute[72520]:   <name>instance-00000003</name>
Aug 02 23:31:02 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:31:02 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:31:02 user nova-compute[72520]:   <metadata>
Aug 02 23:31:02 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:31:02 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:31:02 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-279902656</nova:name>
Aug 02 23:31:02 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:31:02</nova:creationTime>
Aug 02 23:31:02 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:31:02 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:31:02 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:31:02 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:31:02 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:31:02 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:31:02 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:31:02 user nova-compute[72520]:       <nova:owner>
Aug 02 23:31:02 user nova-compute[72520]:         <nova:user uuid="eb9f79446d734cbfa7644b128bbf5275">tempest-AttachVolumeNegativeTest-1376380752-project-member</nova:user>
Aug 02 23:31:02 user nova-compute[72520]:         <nova:project uuid="9052da981a9a4629b46fb0d3533c96c7">tempest-AttachVolumeNegativeTest-1376380752</nova:project>
Aug 02 23:31:02 user nova-compute[72520]:       </nova:owner>
Aug 02 23:31:02 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:31:02 user nova-compute[72520]:       <nova:ports>
Aug 02 23:31:02 user nova-compute[72520]:         <nova:port uuid="40ffeb06-6826-4533-a120-3b8d6b7570b7">
Aug 02 23:31:02 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 02 23:31:02 user nova-compute[72520]:         </nova:port>
Aug 02 23:31:02 user nova-compute[72520]:       </nova:ports>
Aug 02 23:31:02 user nova-compute[72520]:     </nova:instance>
Aug 02 23:31:02 user nova-compute[72520]:   </metadata>
Aug 02 23:31:02 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:31:02 user nova-compute[72520]:     <system>
Aug 02 23:31:02 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:31:02 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:31:02 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:31:02 user nova-compute[72520]:       <entry name="serial">b86f31d4-33c5-4b2b-a235-3b07b306f23a</entry>
Aug 02 23:31:02 user nova-compute[72520]:       <entry name="uuid">b86f31d4-33c5-4b2b-a235-3b07b306f23a</entry>
Aug 02 23:31:02 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:31:02 user nova-compute[72520]:     </system>
Aug 02 23:31:02 user nova-compute[72520]:   </sysinfo>
Aug 02 23:31:02 user nova-compute[72520]:   <os>
Aug 02 23:31:02 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:31:02 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:31:02 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:31:02 user nova-compute[72520]:   </os>
Aug 02 23:31:02 user nova-compute[72520]:   <features>
Aug 02 23:31:02 user nova-compute[72520]:     <acpi/>
Aug 02 23:31:02 user nova-compute[72520]:     <apic/>
Aug 02 23:31:02 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:31:02 user nova-compute[72520]:   </features>
Aug 02 23:31:02 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:31:02 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:31:02 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:31:02 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:31:02 user nova-compute[72520]:   </clock>
Aug 02 23:31:02 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:31:02 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:31:02 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:31:02 user nova-compute[72520]:   </cpu>
Aug 02 23:31:02 user nova-compute[72520]:   <devices>
Aug 02 23:31:02 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:31:02 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:31:02 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk"/>
Aug 02 23:31:02 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:31:02 user nova-compute[72520]:     </disk>
Aug 02 23:31:02 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:31:02 user nova-compute[72520]:       <mac address="fa:16:3e:ec:eb:8b"/>
Aug 02 23:31:02 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:02 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:31:02 user nova-compute[72520]:       <target dev="tap40ffeb06-68"/>
Aug 02 23:31:02 user nova-compute[72520]:     </interface>
Aug 02 23:31:02 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:31:02 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/console.log" append="off"/>
Aug 02 23:31:02 user nova-compute[72520]:     </serial>
Aug 02 23:31:02 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:31:02 user nova-compute[72520]:     <video>
Aug 02 23:31:02 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:02 user nova-compute[72520]:     </video>
Aug 02 23:31:02 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:31:02 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:31:02 user nova-compute[72520]:     </rng>
Aug 02 23:31:02 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:31:02 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:31:02 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:31:02 user nova-compute[72520]:     </memballoon>
Aug 02 23:31:02 user nova-compute[72520]:   </devices>
Aug 02 23:31:02 user nova-compute[72520]: </domain>
Aug 02 23:31:02 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-279902656',display_name='tempest-AttachVolumeNegativeTest-server-279902656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-279902656',id=3,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn0BZiujVN+LS36VveXKFJEU+CUFYo49Y6/UfcWGZHzXQg9G4hNqytGTtyySdjvukp+epM7mpTcbf+WEuVs61CzN29omP6pBqisxDasn0hF8Yaez/dbi9LkscfoBSki7g==',key_name='tempest-keypair-1147761571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-oq32vyu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=b86f31d4-33c5-4b2b-a235-3b07b306f23a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:8b,bridge_name='br-int',has_traffic_filtering=True,id=40ffeb06-6826-4533-a120-3b8d6b7570b7,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ffeb06-68') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG os_vif [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:8b,bridge_name='br-int',has_traffic_filtering=True,id=40ffeb06-6826-4533-a120-3b8d6b7570b7,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ffeb06-68') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40ffeb06-68, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40ffeb06-68, col_values=(('external_ids', {'iface-id': '40ffeb06-6826-4533-a120-3b8d6b7570b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:eb:8b', 'vm-uuid': 'b86f31d4-33c5-4b2b-a235-3b07b306f23a'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:02 user nova-compute[72520]: INFO os_vif [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:8b,bridge_name='br-int',has_traffic_filtering=True,id=40ffeb06-6826-4533-a120-3b8d6b7570b7,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ffeb06-68')
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No VIF found with MAC fa:16:3e:ec:eb:8b, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:03 user nova-compute[72520]: DEBUG nova.network.neutron [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updated VIF entry in instance network info cache for port 40ffeb06-6826-4533-a120-3b8d6b7570b7. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:31:03 user nova-compute[72520]: DEBUG nova.network.neutron [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updating instance_info_cache with network_info: [{"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-f655e86d-f9a6-4d7c-8757-810037390d7c req-a1cd806c-78da-4312-baa5-6a6033d17af1 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f655e86d-f9a6-4d7c-8757-810037390d7c req-a1cd806c-78da-4312-baa5-6a6033d17af1 service nova] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f655e86d-f9a6-4d7c-8757-810037390d7c req-a1cd806c-78da-4312-baa5-6a6033d17af1 service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f655e86d-f9a6-4d7c-8757-810037390d7c req-a1cd806c-78da-4312-baa5-6a6033d17af1 service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-f655e86d-f9a6-4d7c-8757-810037390d7c req-a1cd806c-78da-4312-baa5-6a6033d17af1 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] No waiting events found dispatching network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:03 user nova-compute[72520]: WARNING nova.compute.manager [req-f655e86d-f9a6-4d7c-8757-810037390d7c req-a1cd806c-78da-4312-baa5-6a6033d17af1 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received unexpected event network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e for instance with vm_state building and task_state spawning.
Aug 02 23:31:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c641246d-53cf-4c62-b382-9b6f241bf727 req-cc80ce7b-d8cf-4af5-8d82-9960460ba7af service nova] Releasing lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-54cae96b-4b71-43ee-8932-b26fc7259d2a req-46738e31-342a-4365-9f2b-899e8ca0a695 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received event network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54cae96b-4b71-43ee-8932-b26fc7259d2a req-46738e31-342a-4365-9f2b-899e8ca0a695 service nova] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54cae96b-4b71-43ee-8932-b26fc7259d2a req-46738e31-342a-4365-9f2b-899e8ca0a695 service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54cae96b-4b71-43ee-8932-b26fc7259d2a req-46738e31-342a-4365-9f2b-899e8ca0a695 service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-54cae96b-4b71-43ee-8932-b26fc7259d2a req-46738e31-342a-4365-9f2b-899e8ca0a695 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] No waiting events found dispatching network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:04 user nova-compute[72520]: WARNING nova.compute.manager [req-54cae96b-4b71-43ee-8932-b26fc7259d2a req-46738e31-342a-4365-9f2b-899e8ca0a695 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received unexpected event network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b for instance with vm_state building and task_state spawning.
Aug 02 23:31:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019064.8615317, c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] VM Resumed (Lifecycle Event)
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:31:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Instance spawned successfully.
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:04 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019064.8652709, c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] VM Started (Lifecycle Event)
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:05 user nova-compute[72520]: INFO nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Took 16.64 seconds to spawn the instance on the hypervisor.
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:05 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:05 user nova-compute[72520]: INFO nova.compute.manager [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Took 17.68 seconds to build instance.
Aug 02 23:31:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-24a71e31-b79b-485b-a9bb-f4bd87a5d1e3 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.895s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-679501a0-eb04-465e-bd75-138d87e024e0 req-54c44246-0cfc-438b-a922-0a85993db494 service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-679501a0-eb04-465e-bd75-138d87e024e0 req-54c44246-0cfc-438b-a922-0a85993db494 service nova] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-679501a0-eb04-465e-bd75-138d87e024e0 req-54c44246-0cfc-438b-a922-0a85993db494 service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-679501a0-eb04-465e-bd75-138d87e024e0 req-54c44246-0cfc-438b-a922-0a85993db494 service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-679501a0-eb04-465e-bd75-138d87e024e0 req-54c44246-0cfc-438b-a922-0a85993db494 service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] No waiting events found dispatching network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:05 user nova-compute[72520]: WARNING nova.compute.manager [req-679501a0-eb04-465e-bd75-138d87e024e0 req-54c44246-0cfc-438b-a922-0a85993db494 service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received unexpected event network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 for instance with vm_state building and task_state spawning.
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-2236b1f6-7f6b-43f4-bdc6-a94c2dc95a32 req-c53291c3-b7c1-4cf8-8b70-dd2040cf5fdd service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2236b1f6-7f6b-43f4-bdc6-a94c2dc95a32 req-c53291c3-b7c1-4cf8-8b70-dd2040cf5fdd service nova] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2236b1f6-7f6b-43f4-bdc6-a94c2dc95a32 req-c53291c3-b7c1-4cf8-8b70-dd2040cf5fdd service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2236b1f6-7f6b-43f4-bdc6-a94c2dc95a32 req-c53291c3-b7c1-4cf8-8b70-dd2040cf5fdd service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-2236b1f6-7f6b-43f4-bdc6-a94c2dc95a32 req-c53291c3-b7c1-4cf8-8b70-dd2040cf5fdd service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] No waiting events found dispatching network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:05 user nova-compute[72520]: WARNING nova.compute.manager [req-2236b1f6-7f6b-43f4-bdc6-a94c2dc95a32 req-c53291c3-b7c1-4cf8-8b70-dd2040cf5fdd service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received unexpected event network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e for instance with vm_state building and task_state spawning.
Aug 02 23:31:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019065.8225238, 8e524afb-4d71-43a5-8b91-4f558c409237 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:05 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] VM Resumed (Lifecycle Event)
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:31:05 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Instance spawned successfully.
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:05 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019065.8276742, 8e524afb-4d71-43a5-8b91-4f558c409237 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:05 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] VM Started (Lifecycle Event)
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Took 13.39 seconds to spawn the instance on the hypervisor.
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Took 14.21 seconds to build instance.
Aug 02 23:31:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-082f79f4-aaa0-41f5-ba45-b01ac4a28e2c tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "8e524afb-4d71-43a5-8b91-4f558c409237" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.408s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019066.41234, b86f31d4-33c5-4b2b-a235-3b07b306f23a => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] VM Resumed (Lifecycle Event)
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Instance spawned successfully.
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.claims [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Claim successful on node user
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Took 11.52 seconds to spawn the instance on the hypervisor.
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019066.4124947, b86f31d4-33c5-4b2b-a235-3b07b306f23a => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] VM Started (Lifecycle Event)
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:06 user nova-compute[72520]: INFO nova.compute.manager [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Took 12.56 seconds to build instance.
Aug 02 23:31:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-13267b3f-57a7-4da6-a621-c1db3fbf3c76 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.714s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.network.neutron [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:31:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.policy [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc828569cbd645fab326233e841d2494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748be8ace1d41ba8508d59f8f8373d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:31:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Creating image(s)
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "/opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "/opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.236s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-96f1a64e-285d-4135-9af3-d8abf92167aa req-0e6de4ab-1728-4f0c-829e-6fc7114912ec service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96f1a64e-285d-4135-9af3-d8abf92167aa req-0e6de4ab-1728-4f0c-829e-6fc7114912ec service nova] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96f1a64e-285d-4135-9af3-d8abf92167aa req-0e6de4ab-1728-4f0c-829e-6fc7114912ec service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96f1a64e-285d-4135-9af3-d8abf92167aa req-0e6de4ab-1728-4f0c-829e-6fc7114912ec service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-96f1a64e-285d-4135-9af3-d8abf92167aa req-0e6de4ab-1728-4f0c-829e-6fc7114912ec service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] No waiting events found dispatching network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:07 user nova-compute[72520]: WARNING nova.compute.manager [req-96f1a64e-285d-4135-9af3-d8abf92167aa req-0e6de4ab-1728-4f0c-829e-6fc7114912ec service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received unexpected event network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 for instance with vm_state active and task_state None.
Aug 02 23:31:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.294s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk 1073741824" returned: 0 in 0.084s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.294s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Cannot resize image /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG nova.objects.instance [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'migration_context' on Instance uuid a9fa9eda-ec05-4346-8694-89c2cd021663 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Ensure instance console log exists: /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Successfully created port: 5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:31:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Successfully updated port: 5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquired lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-changed-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Refreshing instance network info cache due to event network-changed-5f966658-578f-4fc0-8158-a68b0b92b3f1. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] Acquiring lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updating instance_info_cache with network_info: [{"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Releasing lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Instance network_info: |[{"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] Acquired lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.network.neutron [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Refreshing network info cache for port 5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Start _get_guest_xml network_info=[{"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:31:11 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:11 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1114024249',display_name='tempest-VolumesAdminNegativeTest-server-1114024249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1114024249',id=4,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqVUCCYK/wDkQcqBvulgqVMjaKqev9tCSc/+yAuaXV7gzU+C0mzZE2kG5Snt4g9gH25LpMVRjlYufsKh7vaMswmfZJNMSWQSUSVfkeUwsjTxQ5E25vbpbTZk7/EG3Mzgg==',key_name='tempest-keypair-1441263731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3748be8ace1d41ba8508d59f8f8373d8',ramdisk_id='',reservation_id='r-y36b5t0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-662521094',owner_user_name='tempest-VolumesAdminNegativeTest-662521094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc828569cbd645fab326233e841d2494',uuid=a9fa9eda-ec05-4346-8694-89c2cd021663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converting VIF {"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:49,bridge_name='br-int',has_traffic_filtering=True,id=5f966658-578f-4fc0-8158-a68b0b92b3f1,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f966658-57') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'pci_devices' on Instance uuid a9fa9eda-ec05-4346-8694-89c2cd021663 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:31:11 user nova-compute[72520]:   <uuid>a9fa9eda-ec05-4346-8694-89c2cd021663</uuid>
Aug 02 23:31:11 user nova-compute[72520]:   <name>instance-00000004</name>
Aug 02 23:31:11 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:31:11 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:31:11 user nova-compute[72520]:   <metadata>
Aug 02 23:31:11 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:31:11 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:31:11 user nova-compute[72520]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1114024249</nova:name>
Aug 02 23:31:11 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:31:11</nova:creationTime>
Aug 02 23:31:11 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:31:11 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:31:11 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:31:11 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:31:11 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:31:11 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:31:11 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:31:11 user nova-compute[72520]:       <nova:owner>
Aug 02 23:31:11 user nova-compute[72520]:         <nova:user uuid="cc828569cbd645fab326233e841d2494">tempest-VolumesAdminNegativeTest-662521094-project-member</nova:user>
Aug 02 23:31:11 user nova-compute[72520]:         <nova:project uuid="3748be8ace1d41ba8508d59f8f8373d8">tempest-VolumesAdminNegativeTest-662521094</nova:project>
Aug 02 23:31:11 user nova-compute[72520]:       </nova:owner>
Aug 02 23:31:11 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:31:11 user nova-compute[72520]:       <nova:ports>
Aug 02 23:31:11 user nova-compute[72520]:         <nova:port uuid="5f966658-578f-4fc0-8158-a68b0b92b3f1">
Aug 02 23:31:11 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 02 23:31:11 user nova-compute[72520]:         </nova:port>
Aug 02 23:31:11 user nova-compute[72520]:       </nova:ports>
Aug 02 23:31:11 user nova-compute[72520]:     </nova:instance>
Aug 02 23:31:11 user nova-compute[72520]:   </metadata>
Aug 02 23:31:11 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:31:11 user nova-compute[72520]:     <system>
Aug 02 23:31:11 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:31:11 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:31:11 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:31:11 user nova-compute[72520]:       <entry name="serial">a9fa9eda-ec05-4346-8694-89c2cd021663</entry>
Aug 02 23:31:11 user nova-compute[72520]:       <entry name="uuid">a9fa9eda-ec05-4346-8694-89c2cd021663</entry>
Aug 02 23:31:11 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:31:11 user nova-compute[72520]:     </system>
Aug 02 23:31:11 user nova-compute[72520]:   </sysinfo>
Aug 02 23:31:11 user nova-compute[72520]:   <os>
Aug 02 23:31:11 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:31:11 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:31:11 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:31:11 user nova-compute[72520]:   </os>
Aug 02 23:31:11 user nova-compute[72520]:   <features>
Aug 02 23:31:11 user nova-compute[72520]:     <acpi/>
Aug 02 23:31:11 user nova-compute[72520]:     <apic/>
Aug 02 23:31:11 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:31:11 user nova-compute[72520]:   </features>
Aug 02 23:31:11 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:31:11 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:31:11 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:31:11 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:31:11 user nova-compute[72520]:   </clock>
Aug 02 23:31:11 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:31:11 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:31:11 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:31:11 user nova-compute[72520]:   </cpu>
Aug 02 23:31:11 user nova-compute[72520]:   <devices>
Aug 02 23:31:11 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:31:11 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:31:11 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk"/>
Aug 02 23:31:11 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:31:11 user nova-compute[72520]:     </disk>
Aug 02 23:31:11 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:31:11 user nova-compute[72520]:       <mac address="fa:16:3e:e9:c5:49"/>
Aug 02 23:31:11 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:11 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:31:11 user nova-compute[72520]:       <target dev="tap5f966658-57"/>
Aug 02 23:31:11 user nova-compute[72520]:     </interface>
Aug 02 23:31:11 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:31:11 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/console.log" append="off"/>
Aug 02 23:31:11 user nova-compute[72520]:     </serial>
Aug 02 23:31:11 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:31:11 user nova-compute[72520]:     <video>
Aug 02 23:31:11 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:11 user nova-compute[72520]:     </video>
Aug 02 23:31:11 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:31:11 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:31:11 user nova-compute[72520]:     </rng>
Aug 02 23:31:11 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:31:11 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:31:11 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:31:11 user nova-compute[72520]:     </memballoon>
Aug 02 23:31:11 user nova-compute[72520]:   </devices>
Aug 02 23:31:11 user nova-compute[72520]: </domain>
Aug 02 23:31:11 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1114024249',display_name='tempest-VolumesAdminNegativeTest-server-1114024249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1114024249',id=4,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqVUCCYK/wDkQcqBvulgqVMjaKqev9tCSc/+yAuaXV7gzU+C0mzZE2kG5Snt4g9gH25LpMVRjlYufsKh7vaMswmfZJNMSWQSUSVfkeUwsjTxQ5E25vbpbTZk7/EG3Mzgg==',key_name='tempest-keypair-1441263731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3748be8ace1d41ba8508d59f8f8373d8',ramdisk_id='',reservation_id='r-y36b5t0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-662521094',owner_user_name='tempest-VolumesAdminNegativeTest-662521094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc828569cbd645fab326233e841d2494',uuid=a9fa9eda-ec05-4346-8694-89c2cd021663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converting VIF {"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:49,bridge_name='br-int',has_traffic_filtering=True,id=5f966658-578f-4fc0-8158-a68b0b92b3f1,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f966658-57') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG os_vif [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:49,bridge_name='br-int',has_traffic_filtering=True,id=5f966658-578f-4fc0-8158-a68b0b92b3f1,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f966658-57') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f966658-57, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f966658-57, col_values=(('external_ids', {'iface-id': '5f966658-578f-4fc0-8158-a68b0b92b3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:c5:49', 'vm-uuid': 'a9fa9eda-ec05-4346-8694-89c2cd021663'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:11 user nova-compute[72520]: INFO os_vif [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:49,bridge_name='br-int',has_traffic_filtering=True,id=5f966658-578f-4fc0-8158-a68b0b92b3f1,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f966658-57')
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:31:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] No VIF found with MAC fa:16:3e:e9:c5:49, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:31:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updated VIF entry in instance network info cache for port 5f966658-578f-4fc0-8158-a68b0b92b3f1. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:31:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updating instance_info_cache with network_info: [{"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b0b75a0-eea9-4c3f-b376-0d8c5850b31f req-ea80b38a-4b4f-4c00-ab46-cc0fdbf49555 service nova] Releasing lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-83a331fc-7963-4867-a5c1-2155cd447e3e req-fcd8acda-f296-44ae-93ed-1d31ccb3ac65 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-83a331fc-7963-4867-a5c1-2155cd447e3e req-fcd8acda-f296-44ae-93ed-1d31ccb3ac65 service nova] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-83a331fc-7963-4867-a5c1-2155cd447e3e req-fcd8acda-f296-44ae-93ed-1d31ccb3ac65 service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-83a331fc-7963-4867-a5c1-2155cd447e3e req-fcd8acda-f296-44ae-93ed-1d31ccb3ac65 service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-83a331fc-7963-4867-a5c1-2155cd447e3e req-fcd8acda-f296-44ae-93ed-1d31ccb3ac65 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] No waiting events found dispatching network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:14 user nova-compute[72520]: WARNING nova.compute.manager [req-83a331fc-7963-4867-a5c1-2155cd447e3e req-fcd8acda-f296-44ae-93ed-1d31ccb3ac65 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received unexpected event network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 for instance with vm_state building and task_state spawning.
Aug 02 23:31:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-882a91fb-9fb5-433a-aa67-ac9885f13832 req-a9fb8bc4-8786-400e-aca7-3b1fd3f4684f service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-882a91fb-9fb5-433a-aa67-ac9885f13832 req-a9fb8bc4-8786-400e-aca7-3b1fd3f4684f service nova] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-882a91fb-9fb5-433a-aa67-ac9885f13832 req-a9fb8bc4-8786-400e-aca7-3b1fd3f4684f service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-882a91fb-9fb5-433a-aa67-ac9885f13832 req-a9fb8bc4-8786-400e-aca7-3b1fd3f4684f service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-882a91fb-9fb5-433a-aa67-ac9885f13832 req-a9fb8bc4-8786-400e-aca7-3b1fd3f4684f service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] No waiting events found dispatching network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:16 user nova-compute[72520]: WARNING nova.compute.manager [req-882a91fb-9fb5-433a-aa67-ac9885f13832 req-a9fb8bc4-8786-400e-aca7-3b1fd3f4684f service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received unexpected event network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 for instance with vm_state building and task_state spawning.
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019076.3130934, a9fa9eda-ec05-4346-8694-89c2cd021663 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] VM Resumed (Lifecycle Event)
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Instance spawned successfully.
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:31:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019076.3182557, a9fa9eda-ec05-4346-8694-89c2cd021663 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] VM Started (Lifecycle Event)
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:16 user nova-compute[72520]: INFO nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Took 9.18 seconds to spawn the instance on the hypervisor.
Aug 02 23:31:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:16 user nova-compute[72520]: INFO nova.compute.manager [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Took 10.38 seconds to build instance.
Aug 02 23:31:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-10c130e5-b357-4d4e-8f3a-0f66602a198e tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.585s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:19 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:31:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:31:19 user nova-compute[72520]: INFO nova.compute.claims [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Claim successful on node user
Aug 02 23:31:20 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:31:20 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:31:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.812s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:31:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:31:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:31:20 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 02 23:31:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:31:20 user nova-compute[72520]: DEBUG nova.policy [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd3cf19d1e3e4011958f3520267fec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2437b1253447ecb0dccf0fc3c42aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:31:21 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Creating image(s)
Aug 02 23:31:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "/opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "/opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "/opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "2ab364876d6313528cfcaa8c770ed547deafb44b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "2ab364876d6313528cfcaa8c770ed547deafb44b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.part --force-share --output=json" returned: 0 in 0.226s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG nova.virt.images [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] 9a2e6a57-a143-4c22-ab74-972e4b9a2ba9 was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.part /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.part /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.converted" returned: 0 in 0.275s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Successfully created port: a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b.converted --force-share --output=json" returned: 0 in 0.344s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "2ab364876d6313528cfcaa8c770ed547deafb44b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.645s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b --force-share --output=json" returned: 0 in 0.182s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "2ab364876d6313528cfcaa8c770ed547deafb44b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "2ab364876d6313528cfcaa8c770ed547deafb44b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b --force-share --output=json" returned: 0 in 0.200s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b,backing_fmt=raw /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b,backing_fmt=raw /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk 1073741824" returned: 0 in 0.064s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "2ab364876d6313528cfcaa8c770ed547deafb44b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b --force-share --output=json" returned: 0 in 0.197s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Cannot resize image /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.objects.instance [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lazy-loading 'migration_context' on Instance uuid 48011512-bf0e-46a2-8519-1a117fd974fe {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Ensure instance console log exists: /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Successfully updated port: a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-changed-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Refreshing instance network info cache due to event network-changed-a95ab9fc-0628-4709-b258-d73fb107be13. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] Acquiring lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] Acquired lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Refreshing network info cache for port a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:31:23 user nova-compute[72520]: INFO nova.compute.claims [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Claim successful on node user
Aug 02 23:31:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:31:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de809824-3021-4fbb-8188-ab1bc32b87a9 req-d79d9bae-3290-45dd-af6f-67309c213634 service nova] Releasing lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquired lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.policy [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c54b2dcc75514f84a7122b50e2a8800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056c4e1e57dd46ddb0d8266dd97afac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:31:25 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Creating image(s)
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "/opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "/opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "/opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk 1073741824" returned: 0 in 0.049s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Cannot resize image /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.objects.instance [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lazy-loading 'migration_context' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Ensure instance console log exists: /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Updating instance_info_cache with network_info: [{"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Releasing lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:25 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Instance network_info: |[{"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Start _get_guest_xml network_info=[{"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:31:11Z,direct_url=<?>,disk_format='qcow2',id=9a2e6a57-a143-4c22-ab74-972e4b9a2ba9,min_disk=0,min_ram=0,name='',owner='aacf6b7af7a94e2b918c87fe1b14cf29',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:31:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'image_id': '9a2e6a57-a143-4c22-ab74-972e4b9a2ba9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:31:26 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:26 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:31:11Z,direct_url=<?>,disk_format='qcow2',id=9a2e6a57-a143-4c22-ab74-972e4b9a2ba9,min_disk=0,min_ram=0,name='',owner='aacf6b7af7a94e2b918c87fe1b14cf29',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:31:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-149293802',display_name='tempest-AttachSCSIVolumeTestJSON-server-149293802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-149293802',id=5,image_ref='9a2e6a57-a143-4c22-ab74-972e4b9a2ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHKOn3unPQxkTtb20KTTU7ir/W/eefn7COkfehdPAX7z9RdMWcEXtESqUMZ1Pl6ZBbqW7xX8WbuJgEsHy8Un2oU4VQceEa/NtQgsvjOVvhLQNRdWoMnifeDAOGUAM8ww==',key_name='tempest-keypair-1498364174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d2437b1253447ecb0dccf0fc3c42aaf',ramdisk_id='',reservation_id='r-2gygr20f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a2e6a57-a143-4c22-ab74-972e4b9a2ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-406649529',owner_user_name='tempest-AttachSCSIVolumeTestJSON-406649529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cf19d1e3e4011958f3520267fec0c',uuid=48011512-bf0e-46a2-8519-1a117fd974fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Converting VIF {"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:14:32,bridge_name='br-int',has_traffic_filtering=True,id=a95ab9fc-0628-4709-b258-d73fb107be13,network=Network(73eef370-2441-4c21-b234-821c0fc8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa95ab9fc-06') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.objects.instance [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lazy-loading 'pci_devices' on Instance uuid 48011512-bf0e-46a2-8519-1a117fd974fe {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:31:26 user nova-compute[72520]:   <uuid>48011512-bf0e-46a2-8519-1a117fd974fe</uuid>
Aug 02 23:31:26 user nova-compute[72520]:   <name>instance-00000005</name>
Aug 02 23:31:26 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:31:26 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:31:26 user nova-compute[72520]:   <metadata>
Aug 02 23:31:26 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:31:26 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:31:26 user nova-compute[72520]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-149293802</nova:name>
Aug 02 23:31:26 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:31:26</nova:creationTime>
Aug 02 23:31:26 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:31:26 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:31:26 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:31:26 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:31:26 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:31:26 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:31:26 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:31:26 user nova-compute[72520]:       <nova:owner>
Aug 02 23:31:26 user nova-compute[72520]:         <nova:user uuid="fd3cf19d1e3e4011958f3520267fec0c">tempest-AttachSCSIVolumeTestJSON-406649529-project-member</nova:user>
Aug 02 23:31:26 user nova-compute[72520]:         <nova:project uuid="5d2437b1253447ecb0dccf0fc3c42aaf">tempest-AttachSCSIVolumeTestJSON-406649529</nova:project>
Aug 02 23:31:26 user nova-compute[72520]:       </nova:owner>
Aug 02 23:31:26 user nova-compute[72520]:       <nova:root type="image" uuid="9a2e6a57-a143-4c22-ab74-972e4b9a2ba9"/>
Aug 02 23:31:26 user nova-compute[72520]:       <nova:ports>
Aug 02 23:31:26 user nova-compute[72520]:         <nova:port uuid="a95ab9fc-0628-4709-b258-d73fb107be13">
Aug 02 23:31:26 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 02 23:31:26 user nova-compute[72520]:         </nova:port>
Aug 02 23:31:26 user nova-compute[72520]:       </nova:ports>
Aug 02 23:31:26 user nova-compute[72520]:     </nova:instance>
Aug 02 23:31:26 user nova-compute[72520]:   </metadata>
Aug 02 23:31:26 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:31:26 user nova-compute[72520]:     <system>
Aug 02 23:31:26 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:31:26 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:31:26 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:31:26 user nova-compute[72520]:       <entry name="serial">48011512-bf0e-46a2-8519-1a117fd974fe</entry>
Aug 02 23:31:26 user nova-compute[72520]:       <entry name="uuid">48011512-bf0e-46a2-8519-1a117fd974fe</entry>
Aug 02 23:31:26 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:31:26 user nova-compute[72520]:     </system>
Aug 02 23:31:26 user nova-compute[72520]:   </sysinfo>
Aug 02 23:31:26 user nova-compute[72520]:   <os>
Aug 02 23:31:26 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:31:26 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:31:26 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:31:26 user nova-compute[72520]:   </os>
Aug 02 23:31:26 user nova-compute[72520]:   <features>
Aug 02 23:31:26 user nova-compute[72520]:     <acpi/>
Aug 02 23:31:26 user nova-compute[72520]:     <apic/>
Aug 02 23:31:26 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:31:26 user nova-compute[72520]:   </features>
Aug 02 23:31:26 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:31:26 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:31:26 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:31:26 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:31:26 user nova-compute[72520]:   </clock>
Aug 02 23:31:26 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:31:26 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:31:26 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:31:26 user nova-compute[72520]:   </cpu>
Aug 02 23:31:26 user nova-compute[72520]:   <devices>
Aug 02 23:31:26 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:31:26 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:31:26 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk"/>
Aug 02 23:31:26 user nova-compute[72520]:       <target dev="sda" bus="scsi"/>
Aug 02 23:31:26 user nova-compute[72520]:       <address type="drive" controller="0" unit="0"/>
Aug 02 23:31:26 user nova-compute[72520]:     </disk>
Aug 02 23:31:26 user nova-compute[72520]:     <disk type="file" device="cdrom">
Aug 02 23:31:26 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 02 23:31:26 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk.config"/>
Aug 02 23:31:26 user nova-compute[72520]:       <target dev="sdb" bus="scsi"/>
Aug 02 23:31:26 user nova-compute[72520]:       <address type="drive" controller="0" unit="1"/>
Aug 02 23:31:26 user nova-compute[72520]:     </disk>
Aug 02 23:31:26 user nova-compute[72520]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 02 23:31:26 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:31:26 user nova-compute[72520]:       <mac address="fa:16:3e:6d:14:32"/>
Aug 02 23:31:26 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:26 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:31:26 user nova-compute[72520]:       <target dev="tapa95ab9fc-06"/>
Aug 02 23:31:26 user nova-compute[72520]:     </interface>
Aug 02 23:31:26 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:31:26 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/console.log" append="off"/>
Aug 02 23:31:26 user nova-compute[72520]:     </serial>
Aug 02 23:31:26 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:31:26 user nova-compute[72520]:     <video>
Aug 02 23:31:26 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:26 user nova-compute[72520]:     </video>
Aug 02 23:31:26 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:31:26 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:31:26 user nova-compute[72520]:     </rng>
Aug 02 23:31:26 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:31:26 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:31:26 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:31:26 user nova-compute[72520]:     </memballoon>
Aug 02 23:31:26 user nova-compute[72520]:   </devices>
Aug 02 23:31:26 user nova-compute[72520]: </domain>
Aug 02 23:31:26 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-149293802',display_name='tempest-AttachSCSIVolumeTestJSON-server-149293802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-149293802',id=5,image_ref='9a2e6a57-a143-4c22-ab74-972e4b9a2ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHKOn3unPQxkTtb20KTTU7ir/W/eefn7COkfehdPAX7z9RdMWcEXtESqUMZ1Pl6ZBbqW7xX8WbuJgEsHy8Un2oU4VQceEa/NtQgsvjOVvhLQNRdWoMnifeDAOGUAM8ww==',key_name='tempest-keypair-1498364174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d2437b1253447ecb0dccf0fc3c42aaf',ramdisk_id='',reservation_id='r-2gygr20f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a2e6a57-a143-4c22-ab74-972e4b9a2ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-406649529',owner_user_name='tempest-AttachSCSIVolumeTestJSON-406649529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cf19d1e3e4011958f3520267fec0c',uuid=48011512-bf0e-46a2-8519-1a117fd974fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Converting VIF {"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:14:32,bridge_name='br-int',has_traffic_filtering=True,id=a95ab9fc-0628-4709-b258-d73fb107be13,network=Network(73eef370-2441-4c21-b234-821c0fc8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa95ab9fc-06') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG os_vif [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:14:32,bridge_name='br-int',has_traffic_filtering=True,id=a95ab9fc-0628-4709-b258-d73fb107be13,network=Network(73eef370-2441-4c21-b234-821c0fc8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa95ab9fc-06') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa95ab9fc-06, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa95ab9fc-06, col_values=(('external_ids', {'iface-id': 'a95ab9fc-0628-4709-b258-d73fb107be13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:14:32', 'vm-uuid': '48011512-bf0e-46a2-8519-1a117fd974fe'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:26 user nova-compute[72520]: INFO os_vif [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:14:32,bridge_name='br-int',has_traffic_filtering=True,id=a95ab9fc-0628-4709-b258-d73fb107be13,network=Network(73eef370-2441-4c21-b234-821c0fc8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa95ab9fc-06')
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] No BDM found with device name sda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] No VIF found with MAC fa:16:3e:6d:14:32, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:31:26 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Using config drive
Aug 02 23:31:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:26 user nova-compute[72520]: DEBUG nova.network.neutron [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Successfully created port: 895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:31:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Creating config drive at /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk.config
Aug 02 23:31:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp5cw45ps {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp5cw45ps" returned: 0 in 0.076s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Successfully updated port: 895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquired lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received event network-changed-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Refreshing instance network info cache due to event network-changed-895193a1-de0e-418c-871f-eab8db933ed4. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] Acquiring lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d1881d8-f26b-486e-8741-adf819e9f28a req-ad74005a-4c73-4b81-a933-548b785b9195 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d1881d8-f26b-486e-8741-adf819e9f28a req-ad74005a-4c73-4b81-a933-548b785b9195 service nova] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d1881d8-f26b-486e-8741-adf819e9f28a req-ad74005a-4c73-4b81-a933-548b785b9195 service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d1881d8-f26b-486e-8741-adf819e9f28a req-ad74005a-4c73-4b81-a933-548b785b9195 service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d1881d8-f26b-486e-8741-adf819e9f28a req-ad74005a-4c73-4b81-a933-548b785b9195 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] No waiting events found dispatching network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:29 user nova-compute[72520]: WARNING nova.compute.manager [req-8d1881d8-f26b-486e-8741-adf819e9f28a req-ad74005a-4c73-4b81-a933-548b785b9195 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received unexpected event network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 for instance with vm_state building and task_state spawning.
Aug 02 23:31:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.network.neutron [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Updating instance_info_cache with network_info: [{"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Releasing lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Instance network_info: |[{"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] Acquired lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Refreshing network info cache for port 895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Start _get_guest_xml network_info=[{"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:31:30 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:30 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1149143244',display_name='tempest-TestVolumeSwap-server-1149143244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1149143244',id=6,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrR/68gjpVtSLkCkHP17+vxRoprqZ8exlkFQlBTEwn9DBGXID9ZxNNfxWw0J8KEzUMVAFTPUKXLdtjnKXlSqlE6qPXyxe7fJWIMw6fpQfiHKulojBtjWIXd/DRX3k84gA==',key_name='tempest-keypair-30034236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056c4e1e57dd46ddb0d8266dd97afac0',ramdisk_id='',reservation_id='r-uts09me5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-509973836',owner_user_name='tempest-TestVolumeSwap-509973836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:31:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54b2dcc75514f84a7122b50e2a8800b',uuid=231d5de3-cf80-43bd-90b8-58182eb36fdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Converting VIF {"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2e:5a,bridge_name='br-int',has_traffic_filtering=True,id=895193a1-de0e-418c-871f-eab8db933ed4,network=Network(913a902d-bc53-4a48-9fdc-5e3aeb721b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895193a1-de') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.objects.instance [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lazy-loading 'pci_devices' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:31:30 user nova-compute[72520]:   <uuid>231d5de3-cf80-43bd-90b8-58182eb36fdd</uuid>
Aug 02 23:31:30 user nova-compute[72520]:   <name>instance-00000006</name>
Aug 02 23:31:30 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:31:30 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:31:30 user nova-compute[72520]:   <metadata>
Aug 02 23:31:30 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:31:30 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:31:30 user nova-compute[72520]:       <nova:name>tempest-TestVolumeSwap-server-1149143244</nova:name>
Aug 02 23:31:30 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:31:30</nova:creationTime>
Aug 02 23:31:30 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:31:30 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:31:30 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:31:30 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:31:30 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:31:30 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:31:30 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:31:30 user nova-compute[72520]:       <nova:owner>
Aug 02 23:31:30 user nova-compute[72520]:         <nova:user uuid="c54b2dcc75514f84a7122b50e2a8800b">tempest-TestVolumeSwap-509973836-project-member</nova:user>
Aug 02 23:31:30 user nova-compute[72520]:         <nova:project uuid="056c4e1e57dd46ddb0d8266dd97afac0">tempest-TestVolumeSwap-509973836</nova:project>
Aug 02 23:31:30 user nova-compute[72520]:       </nova:owner>
Aug 02 23:31:30 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:31:30 user nova-compute[72520]:       <nova:ports>
Aug 02 23:31:30 user nova-compute[72520]:         <nova:port uuid="895193a1-de0e-418c-871f-eab8db933ed4">
Aug 02 23:31:30 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 02 23:31:30 user nova-compute[72520]:         </nova:port>
Aug 02 23:31:30 user nova-compute[72520]:       </nova:ports>
Aug 02 23:31:30 user nova-compute[72520]:     </nova:instance>
Aug 02 23:31:30 user nova-compute[72520]:   </metadata>
Aug 02 23:31:30 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:31:30 user nova-compute[72520]:     <system>
Aug 02 23:31:30 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:31:30 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:31:30 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:31:30 user nova-compute[72520]:       <entry name="serial">231d5de3-cf80-43bd-90b8-58182eb36fdd</entry>
Aug 02 23:31:30 user nova-compute[72520]:       <entry name="uuid">231d5de3-cf80-43bd-90b8-58182eb36fdd</entry>
Aug 02 23:31:30 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:31:30 user nova-compute[72520]:     </system>
Aug 02 23:31:30 user nova-compute[72520]:   </sysinfo>
Aug 02 23:31:30 user nova-compute[72520]:   <os>
Aug 02 23:31:30 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:31:30 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:31:30 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:31:30 user nova-compute[72520]:   </os>
Aug 02 23:31:30 user nova-compute[72520]:   <features>
Aug 02 23:31:30 user nova-compute[72520]:     <acpi/>
Aug 02 23:31:30 user nova-compute[72520]:     <apic/>
Aug 02 23:31:30 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:31:30 user nova-compute[72520]:   </features>
Aug 02 23:31:30 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:31:30 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:31:30 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:31:30 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:31:30 user nova-compute[72520]:   </clock>
Aug 02 23:31:30 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:31:30 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:31:30 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:31:30 user nova-compute[72520]:   </cpu>
Aug 02 23:31:30 user nova-compute[72520]:   <devices>
Aug 02 23:31:30 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:31:30 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:31:30 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk"/>
Aug 02 23:31:30 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:31:30 user nova-compute[72520]:     </disk>
Aug 02 23:31:30 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:31:30 user nova-compute[72520]:       <mac address="fa:16:3e:1b:2e:5a"/>
Aug 02 23:31:30 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:30 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:31:30 user nova-compute[72520]:       <target dev="tap895193a1-de"/>
Aug 02 23:31:30 user nova-compute[72520]:     </interface>
Aug 02 23:31:30 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:31:30 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/console.log" append="off"/>
Aug 02 23:31:30 user nova-compute[72520]:     </serial>
Aug 02 23:31:30 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:31:30 user nova-compute[72520]:     <video>
Aug 02 23:31:30 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:31:30 user nova-compute[72520]:     </video>
Aug 02 23:31:30 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:31:30 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:31:30 user nova-compute[72520]:     </rng>
Aug 02 23:31:30 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:31:30 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:31:30 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:31:30 user nova-compute[72520]:     </memballoon>
Aug 02 23:31:30 user nova-compute[72520]:   </devices>
Aug 02 23:31:30 user nova-compute[72520]: </domain>
Aug 02 23:31:30 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1149143244',display_name='tempest-TestVolumeSwap-server-1149143244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1149143244',id=6,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrR/68gjpVtSLkCkHP17+vxRoprqZ8exlkFQlBTEwn9DBGXID9ZxNNfxWw0J8KEzUMVAFTPUKXLdtjnKXlSqlE6qPXyxe7fJWIMw6fpQfiHKulojBtjWIXd/DRX3k84gA==',key_name='tempest-keypair-30034236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056c4e1e57dd46ddb0d8266dd97afac0',ramdisk_id='',reservation_id='r-uts09me5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-509973836',owner_user_name='tempest-TestVolumeSwap-509973836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:31:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54b2dcc75514f84a7122b50e2a8800b',uuid=231d5de3-cf80-43bd-90b8-58182eb36fdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Converting VIF {"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2e:5a,bridge_name='br-int',has_traffic_filtering=True,id=895193a1-de0e-418c-871f-eab8db933ed4,network=Network(913a902d-bc53-4a48-9fdc-5e3aeb721b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895193a1-de') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG os_vif [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2e:5a,bridge_name='br-int',has_traffic_filtering=True,id=895193a1-de0e-418c-871f-eab8db933ed4,network=Network(913a902d-bc53-4a48-9fdc-5e3aeb721b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895193a1-de') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap895193a1-de, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap895193a1-de, col_values=(('external_ids', {'iface-id': '895193a1-de0e-418c-871f-eab8db933ed4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:2e:5a', 'vm-uuid': '231d5de3-cf80-43bd-90b8-58182eb36fdd'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:30 user nova-compute[72520]: INFO os_vif [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:2e:5a,bridge_name='br-int',has_traffic_filtering=True,id=895193a1-de0e-418c-871f-eab8db933ed4,network=Network(913a902d-bc53-4a48-9fdc-5e3aeb721b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895193a1-de')
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:31:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] No VIF found with MAC fa:16:3e:1b:2e:5a, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.network.neutron [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Updated VIF entry in instance network info cache for port 895193a1-de0e-418c-871f-eab8db933ed4. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.network.neutron [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Updating instance_info_cache with network_info: [{"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3a120253-1803-4964-8061-90976b0203a4 req-22e04284-994e-40a4-bf89-fa958eb6ce48 service nova] Releasing lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019091.0823307, 48011512-bf0e-46a2-8519-1a117fd974fe => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] VM Resumed (Lifecycle Event)
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:31:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Instance spawned successfully.
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019091.0859284, 48011512-bf0e-46a2-8519-1a117fd974fe => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] VM Started (Lifecycle Event)
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:31 user nova-compute[72520]: INFO nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Took 10.27 seconds to spawn the instance on the hypervisor.
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:31 user nova-compute[72520]: INFO nova.compute.manager [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Took 11.80 seconds to build instance.
Aug 02 23:31:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-eede2f20-437b-4b33-bc94-477fa5a4116d tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.126s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-e59aca9a-11fe-436b-bd55-9fb6a016fb17 req-cd2f99e0-fbcd-4e4d-bce3-50d3c415f3df service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e59aca9a-11fe-436b-bd55-9fb6a016fb17 req-cd2f99e0-fbcd-4e4d-bce3-50d3c415f3df service nova] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e59aca9a-11fe-436b-bd55-9fb6a016fb17 req-cd2f99e0-fbcd-4e4d-bce3-50d3c415f3df service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e59aca9a-11fe-436b-bd55-9fb6a016fb17 req-cd2f99e0-fbcd-4e4d-bce3-50d3c415f3df service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-e59aca9a-11fe-436b-bd55-9fb6a016fb17 req-cd2f99e0-fbcd-4e4d-bce3-50d3c415f3df service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] No waiting events found dispatching network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:31 user nova-compute[72520]: WARNING nova.compute.manager [req-e59aca9a-11fe-436b-bd55-9fb6a016fb17 req-cd2f99e0-fbcd-4e4d-bce3-50d3c415f3df service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received unexpected event network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 for instance with vm_state active and task_state None.
Aug 02 23:31:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG nova.compute.manager [req-9912ec11-7c27-4774-91b1-11047c34d7e0 req-ea700599-36b7-4cfc-9a88-8bbe3397f34f service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received event network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9912ec11-7c27-4774-91b1-11047c34d7e0 req-ea700599-36b7-4cfc-9a88-8bbe3397f34f service nova] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9912ec11-7c27-4774-91b1-11047c34d7e0 req-ea700599-36b7-4cfc-9a88-8bbe3397f34f service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9912ec11-7c27-4774-91b1-11047c34d7e0 req-ea700599-36b7-4cfc-9a88-8bbe3397f34f service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG nova.compute.manager [req-9912ec11-7c27-4774-91b1-11047c34d7e0 req-ea700599-36b7-4cfc-9a88-8bbe3397f34f service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] No waiting events found dispatching network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:32 user nova-compute[72520]: WARNING nova.compute.manager [req-9912ec11-7c27-4774-91b1-11047c34d7e0 req-ea700599-36b7-4cfc-9a88-8bbe3397f34f service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received unexpected event network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 for instance with vm_state building and task_state spawning.
Aug 02 23:31:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-28bd0b73-76f1-4c9e-813e-4d89a9b28d78 req-165afbd4-caec-4d98-995c-00beb3806ab9 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received event network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-28bd0b73-76f1-4c9e-813e-4d89a9b28d78 req-165afbd4-caec-4d98-995c-00beb3806ab9 service nova] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-28bd0b73-76f1-4c9e-813e-4d89a9b28d78 req-165afbd4-caec-4d98-995c-00beb3806ab9 service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-28bd0b73-76f1-4c9e-813e-4d89a9b28d78 req-165afbd4-caec-4d98-995c-00beb3806ab9 service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-28bd0b73-76f1-4c9e-813e-4d89a9b28d78 req-165afbd4-caec-4d98-995c-00beb3806ab9 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] No waiting events found dispatching network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:31:34 user nova-compute[72520]: WARNING nova.compute.manager [req-28bd0b73-76f1-4c9e-813e-4d89a9b28d78 req-165afbd4-caec-4d98-995c-00beb3806ab9 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received unexpected event network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 for instance with vm_state building and task_state spawning.
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019094.8210106, 231d5de3-cf80-43bd-90b8-58182eb36fdd => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] VM Resumed (Lifecycle Event)
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:31:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Instance spawned successfully.
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:31:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019094.826346, 231d5de3-cf80-43bd-90b8-58182eb36fdd => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:31:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] VM Started (Lifecycle Event)
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:31:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:31:35 user nova-compute[72520]: INFO nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Took 9.87 seconds to spawn the instance on the hypervisor.
Aug 02 23:31:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:31:35 user nova-compute[72520]: INFO nova.compute.manager [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Took 11.20 seconds to build instance.
Aug 02 23:31:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-91b7934b-c0c5-4aaa-a992-1da4d65c0921 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.437s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updating instance_info_cache with network_info: [{"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 02 23:31:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:31:44 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:44 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.84334945678711GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8e524afb-4d71-43a5-8b91-4f558c409237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b86f31d4-33c5-4b2b-a235-3b07b306f23a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a9fa9eda-ec05-4346-8694-89c2cd021663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 48011512-bf0e-46a2-8519-1a117fd974fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 231d5de3-cf80-43bd-90b8-58182eb36fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:31:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:31:45 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:31:45 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:31:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:31:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:31:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:31:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:31:58 user nova-compute[72520]: INFO nova.compute.claims [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Claim successful on node user
Aug 02 23:31:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:31:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:31:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:31:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:31:59 user nova-compute[72520]: INFO nova.virt.block_device [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Booting with volume 0ab4c557-ed85-433e-86ec-673dd7c2842e at /dev/vda
Aug 02 23:31:59 user nova-compute[72520]: DEBUG os_brick.utils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:31:59 user nova-compute[72520]: INFO oslo.privsep.daemon [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdorjrb5b/privsep.sock']
Aug 02 23:31:59 user nova-compute[72520]: DEBUG nova.policy [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1419fb3de83c4743b688b0b3563f92da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4859fb53c10e4bb0a81d1bf982c0ab19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:31:59 user sudo[83012]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdorjrb5b/privsep.sock
Aug 02 23:31:59 user sudo[83012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 02 23:32:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully created port: 16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully created port: 51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully created port: 399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:01 user sudo[83012]: pam_unix(sudo:session): session closed for user root
Aug 02 23:32:01 user nova-compute[72520]: INFO oslo.privsep.daemon [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Spawned new privsep daemon via rootwrap
Aug 02 23:32:01 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 02 23:32:01 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 02 23:32:01 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 02 23:32:01 user nova-compute[72520]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83015
Aug 02 23:32:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36883c79-c513-424b-bf3d-d409eb4f8590]: (2,) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb523ee-5a90-4026-badf-28e9081255bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:02 user nova-compute[72520]: WARNING os_brick.initiator.connectors.nvmeof [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11011bba-40a2-4c6c-91f2-6774eaec9fa3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ba356-3c84-44ca-9d93-33f4655cc5c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d73e5-82f2-4d4b-931b-fbcfba78c695]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:02 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[95603ddf-70c1-4132-9419-ba68377e3c78]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG os_brick.utils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== get_connector_properties: return (2497ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating existing volume attachment record: 381e0b18-c3c4-48c7-851b-55f24623f888 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully created port: 94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:03 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully created port: a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully updated port: 16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-16a63599-268a-4034-a37b-5d99d65a2656. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:04 user nova-compute[72520]: DEBUG nova.network.neutron [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port 16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-edbae44e-3262-44cc-a5f6-635d9d59981e req-f0142291-ba6e-40f6-a905-dce1f0363d6c service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully updated port: cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-cddd6045-517e-4178-87e5-a9886bcb67f8. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG nova.network.neutron [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG nova.network.neutron [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully updated port: c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG nova.network.neutron [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a580dbf-73fc-48c9-b771-ec00bb2ebffe req-7c11ac6a-5e7a-48d9-870b-93c87b7f19f7 service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "8938659a-310a-4050-8bf9-5febd9a53886" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:32:08 user nova-compute[72520]: INFO nova.compute.claims [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Claim successful on node user
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully updated port: 51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:32:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:32:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:32:08 user nova-compute[72520]: INFO nova.virt.block_device [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Booting with volume 81b4e2c1-14dc-488c-8c92-8e4e59d24582 at /dev/vda
Aug 02 23:32:09 user nova-compute[72520]: DEBUG os_brick.utils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd796b82-2d1f-4d52-ba67-c9948254568d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ef05a-ef68-496d-8bb9-d70896ace598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[723519c2-b864-45db-8209-84dfe7f3d929]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5efab0c-4baa-4c81-ac00-c9d7b8244d68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.policy [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd1bd63fb59c427b96890b3f22b78390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3998463a9e3e4ef2a170f8483172193b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:09 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f142c4a0-2a53-4bf8-9d7d-44b4ff441e08]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG os_brick.utils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating existing volume attachment record: ffd18f2a-c9c2-4b41-a0db-86acf3ed5b36 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-c0850f91-2a68-4774-af40-1259366f9e60. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-51982c7d-554a-4ea1-914a-ef3819378755. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port 51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:10 user nova-compute[72520]: DEBUG nova.network.neutron [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully updated port: 399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:10 user nova-compute[72520]: DEBUG nova.network.neutron [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully created port: ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-381d12fd-75ea-4b8d-99fe-25d69fd1f82a req-416c4fbc-e712-4591-8e2a-6f9c7c747a80 service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-399eae41-8d85-43c5-91f2-accad5efad35. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG nova.network.neutron [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port 399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully created port: 998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG nova.network.neutron [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully updated port: 94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-336353c4-f014-4152-9cc2-0f65be5f019e req-21e282f5-67be-48e0-a63a-a0f97075be15 service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully created port: ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-94bab03a-50c9-4b36-a064-46035b2f471b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port 94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Successfully updated port: a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully created port: 87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c0cf4170-2919-4101-a63c-bb0875d8a4e0 req-94223f97-79f1-4892-be17-aa7608ae2a4c service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:32:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully created port: 2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:15 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully updated port: ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-a40db34b-cabb-49fe-b042-89be1390f91a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:16 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully updated port: b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:16 user nova-compute[72520]: DEBUG nova.network.neutron [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance network_info: |[{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:32:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:16 user nova-compute[72520]: DEBUG nova.network.neutron [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updated VIF entry in instance network info cache for port a40db34b-cabb-49fe-b042-89be1390f91a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-ad57f528-4885-4c3f-a879-288f26134611. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully updated port: 1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-1587b21b-15d3-4ebe-8322-34fdf0762731. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e5342e31-fb60-431d-ad13-e7a41be86cd5 req-4b6e5372-c05d-448d-8478-3c42c2f57a5f service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port 1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d3b56f3d-45dd-429d-a002-062b4b5b2ea6 req-21dee2ce-08b3-4f4d-ae2d-82f0f5bfacc9 service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-b1609de7-ff62-4ae1-a664-a2c4c33be2d3. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:17 user nova-compute[72520]: INFO nova.virt.block_device [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Booting with volume c262bf3d-60d6-4074-8737-d7b803dd45d1 at /dev/vdb
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.utils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[360c5791-20b9-41eb-89fa-59ce526e1e4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59fd2a-d5b9-4f3f-9538-1b5d9bd52c94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully updated port: 998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9153960-cac4-4a25-8604-25c0ecf2324c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3052c31a-2f52-4903-8f92-e5371d6668e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG nova.network.neutron [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:18 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8971bd79-2345-4d13-b59d-606985904ff6]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.utils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating existing volume attachment record: 675f553b-64e4-4e12-8553-ae1a1ca5d4f8 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17ff7541-28dd-4c2e-9ddc-cfae270c6061 req-6efdb602-e007-4690-8d0b-3f5316791d2f service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:18 user nova-compute[72520]: INFO nova.virt.block_device [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Booting with volume 887f14cb-4bd3-41d9-891f-e9cee8291b20 at /dev/vdb
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.utils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9312d1a-90b1-4c09-909c-256f11a96c10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[392af13e-7c22-4b63-96b4-a46a30243a22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704ca48-e135-49f0-95ae-6864338e8e4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d76e4f-3009-4623-88c2-2e1319acae60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:18 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[293e7878-eec8-481a-9138-e3604e0d1e3a]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG os_brick.utils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating existing volume attachment record: abfdec88-ca47-4bac-86af-6c8f77fade8c {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully updated port: ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-998d8abd-dc7e-47ba-a790-438daf95dddd. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port 998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-ea0882aa-bede-43ae-a5ce-b27b62785ba8. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4a14a3c0-d833-46ab-b093-6d12f8d73c6c req-adbbfd9a-8118-4491-a4d4-d886bdb0bacf service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:19 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully updated port: 87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Successfully updated port: 2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:32:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:32:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-87712eb3-4e14-4c0a-97d9-e76d4c6a262d. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance network_info: |[{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port 87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updated VIF entry in instance network info cache for port 87712eb3-4e14-4c0a-97d9-e76d4c6a262d. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port 2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updated VIF entry in instance network info cache for port 2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fe93369-d27d-45ef-beac-967fcfd69ab4 req-0858e75c-1237-4334-8bb7-b859d54457cc service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:32:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:32:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:32:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:26 user nova-compute[72520]: INFO nova.virt.block_device [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Booting with volume 535e06f2-2778-49bf-aa0f-09f7b271161e at /dev/vdc
Aug 02 23:32:26 user nova-compute[72520]: DEBUG os_brick.utils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2f8f0-de07-49f6-a435-9e67940d157b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0518a88-8b3d-45c9-8b95-d5bbcbbb8384]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c4f84-cb87-4f03-9ba9-7ffcea5f3b53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0997cb0-0598-4332-a846-fdffe16e713d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:26 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[163e806c-4a92-4c5c-aa00-22a741ac7c65]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG os_brick.utils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:26 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating existing volume attachment record: e0ca7e08-6ce3-4095-8360-2fbb12cbc232 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:27 user nova-compute[72520]: INFO nova.virt.block_device [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Booting with volume 463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 at /dev/vdc
Aug 02 23:32:27 user nova-compute[72520]: DEBUG os_brick.utils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebee0a0-a994-4f50-ae6d-b46121f7fea3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff92aebf-5444-4d1e-a677-ebc93c3cefc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a24973a-e641-41e5-bafa-e8c879d6022c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7104da18-c5b1-4bc6-8972-886acb0344fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:27 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee45b35-3b79-4ff8-9b0d-b51520cad10c]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG os_brick.utils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:27 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating existing volume attachment record: 8cd72cf2-9a7f-433b-810a-9206d1f11d20 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:32:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Creating image(s)
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Ensure instance console log exists: /opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Start _get_guest_xml network_info=[{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syhRNGjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8938659a-310a-4050-8bf9-5febd9a53886', 'attached_at': '', 'detached_at': '', 'volume_id': '81b4e2c1-14dc-488c-8c92-8e4e59d24582', 'serial': '81b4e2c1-14dc-488c-8c92-8e4e59d24582'}, 'attachment_id': 'ffd18f2a-c9c2-4b41-a0db-86acf3ed5b36', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtlyenof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8938659a-310a-4050-8bf9-5febd9a53886', 'attached_at': '', 'detached_at': '', 'volume_id': 'c262bf3d-60d6-4074-8737-d7b803dd45d1', 'serial': 'c262bf3d-60d6-4074-8737-d7b803dd45d1'}, 'attachment_id': '675f553b-64e4-4e12-8553-ae1a1ca5d4f8', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKAOFlvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8938659a-310a-4050-8bf9-5febd9a53886', 'attached_at': '', 'detached_at': '', 'volume_id': '535e06f2-2778-49bf-aa0f-09f7b271161e', 'serial': '535e06f2-2778-49bf-aa0f-09f7b271161e'}, 'attachment_id': 'e0ca7e08-6ce3-4095-8360-2fbb12cbc232', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:32:35 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:32:35 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connector [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Factory for ISCSI on None {{(pid=72520) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syhRNGjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:35 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:35 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:35 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83860b-b1cd-4064-8a3f-0c0add5e26e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:32:35 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0bae27-6861-4d2d-b8d5-e6d3b3990632]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582] added
Aug 02 23:32:35 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a930d1-793e-4363-84ca-dcffa27340b0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9ca873-30f8-4c4e-a2d9-cbae83c4daa2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syhRNGjA {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syhRNGjA" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e0264e-453d-496f-8f87-b5751feccf4f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syhRNGjA'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4d879-6703-4a30-bb52-f2cd2a8aed18]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[de08ca78-d18b-4308-a413-30f4de810421]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:32:35 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:32:35 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:35 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 02 23:32:35 user nova-compute[72520]: 
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2961a-8489-45cd-9ba4-ee462d6943b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260]
Aug 02 23:32:35 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260] successful.
Aug 02 23:32:35 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eafde1-9a08-4ce7-a09e-3ee1b268fce6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13cd417-a5f8-4c85-ac4e-fe0cb3ce45b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:35 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:35 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[51271653-f60d-4695-bf00-0f002a38aef4]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syhRNGjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:32:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Creating image(s)
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Ensure instance console log exists: /opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Start _get_guest_xml network_info=[{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caXnSRdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05ac30a1-7637-4346-a2ec-aa438eeef69f', 'attached_at': '', 'detached_at': '', 'volume_id': '0ab4c557-ed85-433e-86ec-673dd7c2842e', 'serial': '0ab4c557-ed85-433e-86ec-673dd7c2842e'}, 'attachment_id': '381e0b18-c3c4-48c7-851b-55f24623f888', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiXhDPzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05ac30a1-7637-4346-a2ec-aa438eeef69f', 'attached_at': '', 'detached_at': '', 'volume_id': '887f14cb-4bd3-41d9-891f-e9cee8291b20', 'serial': '887f14cb-4bd3-41d9-891f-e9cee8291b20'}, 'attachment_id': 'abfdec88-ca47-4bac-86af-6c8f77fade8c', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRFtQScH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05ac30a1-7637-4346-a2ec-aa438eeef69f', 'attached_at': '', 'detached_at': '', 'volume_id': '463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3', 'serial': '463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3'}, 'attachment_id': '8cd72cf2-9a7f-433b-810a-9206d1f11d20', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:32:36 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:32:36 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caXnSRdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:36 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23966663937633238', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966663937633238', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.847s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:36 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:36 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:32:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260" returned: 21 in 0.104s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[721f7f4c-fc64-4fe4-9511-fa630c849406]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:32:37 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtlyenof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:37 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ac37a-d3fb-424c-94a1-a097dc69a599]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e] added
Aug 02 23:32:37 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7d8be-52b8-4ce3-a07b-4bb60ded6231]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95b38c-70a1-4a81-b42b-64566dbd944f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v caXnSRdg {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v caXnSRdg" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[af328df8-f71f-452e-a12b-f4c9c0ca89d7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'caXnSRdg'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db767c69-e401-44a1-845e-dc8daa05ae89]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66116540-04f2-43af-859b-3e2100f89ae3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:37 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:37 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d28096-9881-4e0c-b3c6-4de6b6e0f222]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260]
Aug 02 23:32:37 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260] successful.
Aug 02 23:32:37 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be44495-1d32-4bb8-ac70-6029b06d0563]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c45b2f0-22b0-4fa4-acab-909ce1d42e0f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:37 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:37 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:37 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:37 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ae802a-e874-4905-a1a7-681014ac9418]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:37 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caXnSRdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== connect_volume: return (2219ms) {'type': 'block', 'scsi_wwn': '23537636664306562', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537636664306562', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.242s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:38 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:38 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[946077bc-8c54-41e9-8c4e-a46c06ccce19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:32:38 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiXhDPzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:38 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c0e1e-8105-4ff7-9cb9-f610e3b26f32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1] added
Aug 02 23:32:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3a15a1-1f98-40f9-b973-2a2a72fe46d7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5d3af5-adf4-4fad-b85e-99e1b6e32459]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtlyenof {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xtlyenof" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cade72-f0c8-4c91-b92b-f38a88a332cf]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xtlyenof'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c592fb-9953-4396-945d-cd47bcc3d3f5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bb45c0-15ab-4e79-8154-d8e51806adf1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:38 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:38 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdb5e68-ea92-4ad7-8795-94da8ca7f2d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260]
Aug 02 23:32:38 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260] successful.
Aug 02 23:32:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a06551-ef95-4618-bc1c-6d6305592b28]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[87915f6d-b51d-4d36-8935-348682baf44a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:38 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:38 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:38 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:38 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c6b87a-1b2b-42e1-b5b7-4a50433d32e6]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtlyenof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updating instance_info_cache with network_info: [{"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== connect_volume: return (2589ms) {'type': 'block', 'scsi_wwn': '26437396531376537', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437396531376537', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.318s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:39 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[80144c03-93ba-4367-9c27-6ef9bf7cbfdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:32:39 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKAOFlvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe8665-21cc-4cec-a087-c3840760ac37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20] added
Aug 02 23:32:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0d9bc-234d-4461-bd9b-ed1667afabdc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c82e58d-36ec-475a-967a-4ea2010e174e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiXhDPzV {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiXhDPzV" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4754167-1d1d-4b3f-9cf7-4f1ac1c5923c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kiXhDPzV'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0165eb3-d462-4273-a289-5a6310db3743]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8e286-bc57-4c9f-aa22-dc609b227a1a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416d213-4fed-4b8a-b547-367236bf83f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260]
Aug 02 23:32:39 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260] successful.
Aug 02 23:32:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed274ba3-f69b-4c1e-a9d5-0e9e4f63f947]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2ea617-39ba-4d20-a409-f62fa0e4d1de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ab286c-f512-4d50-8010-60eac95febed]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiXhDPzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG nova.objects.instance [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lazy-loading 'flavor' on Instance uuid c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== connect_volume: return (2655ms) {'type': 'block', 'scsi_wwn': '26537323836326339', 'path': '/dev/sde'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537323836326339', 'path': '/dev/sde'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.300s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:40 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:32:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e4857a-50c6-4863-a92e-e6b13d1ec026]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:32:40 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRFtQScH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:41 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afe00b1-3ab6-41a9-a892-c16a1d3229da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e] added
Aug 02 23:32:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb59f06-0753-4757-bd7f-cc7718958960]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6639cf8b-fd52-4e93-ac60-cfaabf8c8ba1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKAOFlvY {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKAOFlvY" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db7113-c906-42db-bcf6-73ce15f6cdfb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKAOFlvY'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f2c8cd-b9d2-4ece-bb15-f1598d95b28c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[22952afc-e2af-4333-925e-6d577159e751]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:41 user nova-compute[72520]: INFO nova.compute.manager [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Attaching volume 9e94eb19-33ff-4475-9ba2-15a078ce8a19 to /dev/vdb
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0547f86-d58e-4c2e-bbff-7ff059728556]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260]
Aug 02 23:32:41 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260] successful.
Aug 02 23:32:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[69831ff8-ab00-4231-8446-10c73c68cc2b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.utils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01a552b-592e-4a19-94f0-760218df9b03]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:41 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd96c186-9185-48a7-b079-63d945d0f0b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d27d7ec-fcd6-46e0-a47d-f31ef701b2db]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKAOFlvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c0985-601f-49aa-80db-3a7bdbd5e54b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac75190b-4681-44e1-ac0c-6a954df9900d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83f47d-002d-495d-a5db-86ac9c0866ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:41 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3cc36-8c1a-48c0-87a5-8454927a07d3]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG os_brick.utils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updating existing volume attachment record: a0222a6c-0b3f-4307-b171-fc41b3fe93c6 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== connect_volume: return (2645ms) {'type': 'block', 'scsi_wwn': '26264616631366435', 'path': '/dev/sdf'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264616631366435', 'path': '/dev/sdf'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.316s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:42 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[255cbcc8-578b-4e1d-9d88-026c4fadeb94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:32:42 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:40,bridge_name='br-int',has_traffic_filtering=True,id=ad57f528-4885-4c3f-a879-288f26134611,network=Network(d2d03904-05e8-45f4-bfb4-e07602aa9e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad57f528-48') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:a2:fd,bridge_name='br-int',has_traffic_filtering=True,id=b1609de7-ff62-4ae1-a664-a2c4c33be2d3,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1609de7-ff') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:5f:29,bridge_name='br-int',has_traffic_filtering=True,id=1587b21b-15d3-4ebe-8322-34fdf0762731,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1587b21b-15') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:7d:29,bridge_name='br-int',has_traffic_filtering=True,id=998d8abd-dc7e-47ba-a790-438daf95dddd,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8abd-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6b:8a,bridge_name='br-int',has_traffic_filtering=True,id=ea0882aa-bede-43ae-a5ce-b27b62785ba8,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0882aa-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c5:dd,bridge_name='br-int',has_traffic_filtering=True,id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87712eb3-4e') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:e1,bridge_name='br-int',has_traffic_filtering=True,id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adfdd1c-2c') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lazy-loading 'pci_devices' on Instance uuid 8938659a-310a-4050-8bf9-5febd9a53886 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c76654-e806-455a-8900-1b391d156ea7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3] added
Aug 02 23:32:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb0b8b9-055b-44d9-8e36-c8bafcde8035]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:32:42 user nova-compute[72520]:   <uuid>8938659a-310a-4050-8bf9-5febd9a53886</uuid>
Aug 02 23:32:42 user nova-compute[72520]:   <name>instance-00000008</name>
Aug 02 23:32:42 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:32:42 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:32:42 user nova-compute[72520]:   <metadata>
Aug 02 23:32:42 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:32:42 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:32:42 user nova-compute[72520]:       <nova:name>tempest-device-tagging-server-1503938434</nova:name>
Aug 02 23:32:42 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:32:35</nova:creationTime>
Aug 02 23:32:42 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:32:42 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:32:42 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:32:42 user nova-compute[72520]:       <nova:owner>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:user uuid="dd1bd63fb59c427b96890b3f22b78390">tempest-TaggedBootDevicesTest_v242-2032203541-project-member</nova:user>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:project uuid="3998463a9e3e4ef2a170f8483172193b">tempest-TaggedBootDevicesTest_v242-2032203541</nova:project>
Aug 02 23:32:42 user nova-compute[72520]:       </nova:owner>
Aug 02 23:32:42 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:32:42 user nova-compute[72520]:       <nova:ports>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:port uuid="ad57f528-4885-4c3f-a879-288f26134611">
Aug 02 23:32:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 02 23:32:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:port uuid="b1609de7-ff62-4ae1-a664-a2c4c33be2d3">
Aug 02 23:32:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.185" ipVersion="4"/>
Aug 02 23:32:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:port uuid="1587b21b-15d3-4ebe-8322-34fdf0762731">
Aug 02 23:32:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Aug 02 23:32:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:port uuid="998d8abd-dc7e-47ba-a790-438daf95dddd">
Aug 02 23:32:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Aug 02 23:32:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:port uuid="ea0882aa-bede-43ae-a5ce-b27b62785ba8">
Aug 02 23:32:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Aug 02 23:32:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:port uuid="87712eb3-4e14-4c0a-97d9-e76d4c6a262d">
Aug 02 23:32:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 02 23:32:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:42 user nova-compute[72520]:         <nova:port uuid="2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3">
Aug 02 23:32:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 02 23:32:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:42 user nova-compute[72520]:       </nova:ports>
Aug 02 23:32:42 user nova-compute[72520]:     </nova:instance>
Aug 02 23:32:42 user nova-compute[72520]:   </metadata>
Aug 02 23:32:42 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:32:42 user nova-compute[72520]:     <system>
Aug 02 23:32:42 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:32:42 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:32:42 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:32:42 user nova-compute[72520]:       <entry name="serial">8938659a-310a-4050-8bf9-5febd9a53886</entry>
Aug 02 23:32:42 user nova-compute[72520]:       <entry name="uuid">8938659a-310a-4050-8bf9-5febd9a53886</entry>
Aug 02 23:32:42 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:32:42 user nova-compute[72520]:     </system>
Aug 02 23:32:42 user nova-compute[72520]:   </sysinfo>
Aug 02 23:32:42 user nova-compute[72520]:   <os>
Aug 02 23:32:42 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:32:42 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:32:42 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:32:42 user nova-compute[72520]:   </os>
Aug 02 23:32:42 user nova-compute[72520]:   <features>
Aug 02 23:32:42 user nova-compute[72520]:     <acpi/>
Aug 02 23:32:42 user nova-compute[72520]:     <apic/>
Aug 02 23:32:42 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:32:42 user nova-compute[72520]:   </features>
Aug 02 23:32:42 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:32:42 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:32:42 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:32:42 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:32:42 user nova-compute[72520]:   </clock>
Aug 02 23:32:42 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:32:42 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:32:42 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:32:42 user nova-compute[72520]:   </cpu>
Aug 02 23:32:42 user nova-compute[72520]:   <devices>
Aug 02 23:32:42 user nova-compute[72520]:     <disk type="file" device="cdrom">
Aug 02 23:32:42 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 02 23:32:42 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886/disk.config"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="hda" bus="ide"/>
Aug 02 23:32:42 user nova-compute[72520]:     </disk>
Aug 02 23:32:42 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:32:42 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:32:42 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <serial>81b4e2c1-14dc-488c-8c92-8e4e59d24582</serial>
Aug 02 23:32:42 user nova-compute[72520]:     </disk>
Aug 02 23:32:42 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:32:42 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:32:42 user nova-compute[72520]:       <source dev="/dev/sdd"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <serial>c262bf3d-60d6-4074-8737-d7b803dd45d1</serial>
Aug 02 23:32:42 user nova-compute[72520]:     </disk>
Aug 02 23:32:42 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:32:42 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:32:42 user nova-compute[72520]:       <source dev="/dev/sdf"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="vdc" bus="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <serial>535e06f2-2778-49bf-aa0f-09f7b271161e</serial>
Aug 02 23:32:42 user nova-compute[72520]:     </disk>
Aug 02 23:32:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:42 user nova-compute[72520]:       <mac address="fa:16:3e:e4:d9:40"/>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="tapad57f528-48"/>
Aug 02 23:32:42 user nova-compute[72520]:     </interface>
Aug 02 23:32:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:42 user nova-compute[72520]:       <mac address="fa:16:3e:82:a2:fd"/>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="tapb1609de7-ff"/>
Aug 02 23:32:42 user nova-compute[72520]:     </interface>
Aug 02 23:32:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:42 user nova-compute[72520]:       <mac address="fa:16:3e:3b:5f:29"/>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="tap1587b21b-15"/>
Aug 02 23:32:42 user nova-compute[72520]:     </interface>
Aug 02 23:32:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:42 user nova-compute[72520]:       <mac address="fa:16:3e:77:7d:29"/>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="tap998d8abd-dc"/>
Aug 02 23:32:42 user nova-compute[72520]:     </interface>
Aug 02 23:32:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:42 user nova-compute[72520]:       <mac address="fa:16:3e:a3:6b:8a"/>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="tapea0882aa-be"/>
Aug 02 23:32:42 user nova-compute[72520]:     </interface>
Aug 02 23:32:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:42 user nova-compute[72520]:       <mac address="fa:16:3e:ad:c5:dd"/>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="tap87712eb3-4e"/>
Aug 02 23:32:42 user nova-compute[72520]:     </interface>
Aug 02 23:32:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:42 user nova-compute[72520]:       <mac address="fa:16:3e:20:45:e1"/>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:42 user nova-compute[72520]:       <target dev="tap2adfdd1c-2c"/>
Aug 02 23:32:42 user nova-compute[72520]:     </interface>
Aug 02 23:32:42 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:32:42 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886/console.log" append="off"/>
Aug 02 23:32:42 user nova-compute[72520]:     </serial>
Aug 02 23:32:42 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:32:42 user nova-compute[72520]:     <video>
Aug 02 23:32:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:42 user nova-compute[72520]:     </video>
Aug 02 23:32:42 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:32:42 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:32:42 user nova-compute[72520]:     </rng>
Aug 02 23:32:42 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:32:42 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:32:42 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:32:42 user nova-compute[72520]:     </memballoon>
Aug 02 23:32:42 user nova-compute[72520]:   </devices>
Aug 02 23:32:42 user nova-compute[72520]: </domain>
Aug 02 23:32:42 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:40,bridge_name='br-int',has_traffic_filtering=True,id=ad57f528-4885-4c3f-a879-288f26134611,network=Network(d2d03904-05e8-45f4-bfb4-e07602aa9e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad57f528-48') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:40,bridge_name='br-int',has_traffic_filtering=True,id=ad57f528-4885-4c3f-a879-288f26134611,network=Network(d2d03904-05e8-45f4-bfb4-e07602aa9e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad57f528-48') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6571d44-ef6f-4fd8-ae86-7fedac14d2dc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRFtQScH {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad57f528-48, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad57f528-48, col_values=(('external_ids', {'iface-id': 'ad57f528-4885-4c3f-a879-288f26134611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:d9:40', 'vm-uuid': '8938659a-310a-4050-8bf9-5febd9a53886'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:40,bridge_name='br-int',has_traffic_filtering=True,id=ad57f528-4885-4c3f-a879-288f26134611,network=Network(d2d03904-05e8-45f4-bfb4-e07602aa9e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad57f528-48')
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:a2:fd,bridge_name='br-int',has_traffic_filtering=True,id=b1609de7-ff62-4ae1-a664-a2c4c33be2d3,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1609de7-ff') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:a2:fd,bridge_name='br-int',has_traffic_filtering=True,id=b1609de7-ff62-4ae1-a664-a2c4c33be2d3,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1609de7-ff') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRFtQScH" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[355d286b-18ae-4480-8526-00bc7a9e422f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRFtQScH'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1609de7-ff, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1609de7-ff, col_values=(('external_ids', {'iface-id': 'b1609de7-ff62-4ae1-a664-a2c4c33be2d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:a2:fd', 'vm-uuid': '8938659a-310a-4050-8bf9-5febd9a53886'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d55a8a6-629b-4408-9032-d527cfde477f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:a2:fd,bridge_name='br-int',has_traffic_filtering=True,id=b1609de7-ff62-4ae1-a664-a2c4c33be2d3,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1609de7-ff')
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:5f:29,bridge_name='br-int',has_traffic_filtering=True,id=1587b21b-15d3-4ebe-8322-34fdf0762731,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1587b21b-15') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:5f:29,bridge_name='br-int',has_traffic_filtering=True,id=1587b21b-15d3-4ebe-8322-34fdf0762731,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1587b21b-15') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1587b21b-15, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1587b21b-15, col_values=(('external_ids', {'iface-id': '1587b21b-15d3-4ebe-8322-34fdf0762731', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:5f:29', 'vm-uuid': '8938659a-310a-4050-8bf9-5febd9a53886'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f23ffa-d721-42ac-985e-2977088a6ce0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:5f:29,bridge_name='br-int',has_traffic_filtering=True,id=1587b21b-15d3-4ebe-8322-34fdf0762731,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1587b21b-15')
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:7d:29,bridge_name='br-int',has_traffic_filtering=True,id=998d8abd-dc7e-47ba-a790-438daf95dddd,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8abd-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:7d:29,bridge_name='br-int',has_traffic_filtering=True,id=998d8abd-dc7e-47ba-a790-438daf95dddd,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8abd-dc') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap998d8abd-dc, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap998d8abd-dc, col_values=(('external_ids', {'iface-id': '998d8abd-dc7e-47ba-a790-438daf95dddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:7d:29', 'vm-uuid': '8938659a-310a-4050-8bf9-5febd9a53886'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:7d:29,bridge_name='br-int',has_traffic_filtering=True,id=998d8abd-dc7e-47ba-a790-438daf95dddd,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8abd-dc')
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6b:8a,bridge_name='br-int',has_traffic_filtering=True,id=ea0882aa-bede-43ae-a5ce-b27b62785ba8,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0882aa-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6b:8a,bridge_name='br-int',has_traffic_filtering=True,id=ea0882aa-bede-43ae-a5ce-b27b62785ba8,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0882aa-be') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea0882aa-be, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea0882aa-be, col_values=(('external_ids', {'iface-id': 'ea0882aa-bede-43ae-a5ce-b27b62785ba8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:6b:8a', 'vm-uuid': '8938659a-310a-4050-8bf9-5febd9a53886'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f40709-202e-4d1d-b06e-3fe06d44fad9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260]
Aug 02 23:32:42 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260] successful.
Aug 02 23:32:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac79ff-66c1-4e85-b0cd-e66d0659930c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[661f7082-db04-4b26-ac40-8ce0f7d1b0e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6b:8a,bridge_name='br-int',has_traffic_filtering=True,id=ea0882aa-bede-43ae-a5ce-b27b62785ba8,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0882aa-be')
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c5:dd,bridge_name='br-int',has_traffic_filtering=True,id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87712eb3-4e') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c5:dd,bridge_name='br-int',has_traffic_filtering=True,id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87712eb3-4e') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:42 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:32:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87712eb3-4e, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87712eb3-4e, col_values=(('external_ids', {'iface-id': '87712eb3-4e14-4c0a-97d9-e76d4c6a262d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:c5:dd', 'vm-uuid': '8938659a-310a-4050-8bf9-5febd9a53886'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d5062-1c76-421b-b5cd-369e3f37be6a]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRFtQScH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c5:dd,bridge_name='br-int',has_traffic_filtering=True,id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87712eb3-4e')
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:e1,bridge_name='br-int',has_traffic_filtering=True,id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adfdd1c-2c') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:e1,bridge_name='br-int',has_traffic_filtering=True,id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adfdd1c-2c') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2adfdd1c-2c, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2adfdd1c-2c, col_values=(('external_ids', {'iface-id': '2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:45:e1', 'vm-uuid': '8938659a-310a-4050-8bf9-5febd9a53886'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:42 user nova-compute[72520]: INFO os_vif [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:e1,bridge_name='br-int',has_traffic_filtering=True,id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adfdd1c-2c')
Aug 02 23:32:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] No BDM found with device name hda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] No VIF found with MAC fa:16:3e:e4:d9:40, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] No VIF found with MAC fa:16:3e:a3:6b:8a, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:32:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Using config drive
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Creating config drive at /opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886/disk.config
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaby2x89_ {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaby2x89_" returned: 0 in 0.053s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019169.7913094, 8938659a-310a-4050-8bf9-5febd9a53886 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:32:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] VM Resumed (Lifecycle Event)
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 7.971s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== connect_volume: return (9287ms) {'type': 'block', 'scsi_wwn': '26665306433363639', 'path': '/dev/sdg'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665306433363639', 'path': '/dev/sdg'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-changed-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Refreshing instance network info cache due to event network-changed-471151f5-ee67-41d0-817b-333804b86f4e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] Acquiring lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] Acquired lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Refreshing network info cache for port 471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-092fdf1b-39cb-4e18-9b8f-85c0f5f70bb3 req-937128cf-1000-4016-9ebb-5c929cad4a7a service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-092fdf1b-39cb-4e18-9b8f-85c0f5f70bb3 req-937128cf-1000-4016-9ebb-5c929cad4a7a service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-092fdf1b-39cb-4e18-9b8f-85c0f5f70bb3 req-937128cf-1000-4016-9ebb-5c929cad4a7a service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-092fdf1b-39cb-4e18-9b8f-85c0f5f70bb3 req-937128cf-1000-4016-9ebb-5c929cad4a7a service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-092fdf1b-39cb-4e18-9b8f-85c0f5f70bb3 req-937128cf-1000-4016-9ebb-5c929cad4a7a service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-092fdf1b-39cb-4e18-9b8f-85c0f5f70bb3 req-937128cf-1000-4016-9ebb-5c929cad4a7a service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-b233b09d-178d-437c-bcfd-1403220fcd0e req-18116277-adfb-4aec-aaa9-5cff8b25a370 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b233b09d-178d-437c-bcfd-1403220fcd0e req-18116277-adfb-4aec-aaa9-5cff8b25a370 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b233b09d-178d-437c-bcfd-1403220fcd0e req-18116277-adfb-4aec-aaa9-5cff8b25a370 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b233b09d-178d-437c-bcfd-1403220fcd0e req-18116277-adfb-4aec-aaa9-5cff8b25a370 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-b233b09d-178d-437c-bcfd-1403220fcd0e req-18116277-adfb-4aec-aaa9-5cff8b25a370 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-b233b09d-178d-437c-bcfd-1403220fcd0e req-18116277-adfb-4aec-aaa9-5cff8b25a370 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-42913d97-ac11-4c88-83b4-bb2c13c01e41 req-2ac864a7-9442-407b-a659-3be5702facbb service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-42913d97-ac11-4c88-83b4-bb2c13c01e41 req-2ac864a7-9442-407b-a659-3be5702facbb service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-42913d97-ac11-4c88-83b4-bb2c13c01e41 req-2ac864a7-9442-407b-a659-3be5702facbb service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-42913d97-ac11-4c88-83b4-bb2c13c01e41 req-2ac864a7-9442-407b-a659-3be5702facbb service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-42913d97-ac11-4c88-83b4-bb2c13c01e41 req-2ac864a7-9442-407b-a659-3be5702facbb service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-42913d97-ac11-4c88-83b4-bb2c13c01e41 req-2ac864a7-9442-407b-a659-3be5702facbb service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-9264418f-29b2-417a-87ad-ab6dff9fae6f req-6779acf8-6493-442d-b781-f8a3a883d1de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-changed-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Refreshing instance network info cache due to event network-changed-40ffeb06-6826-4533-a120-3b8d6b7570b7. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Acquiring lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Acquired lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Refreshing network info cache for port 40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-6b1126f9-5703-4b4a-aabf-8b7d497d97ae req-6e50b8e7-efc5-4049-a6d3-493b6ee235de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b1126f9-5703-4b4a-aabf-8b7d497d97ae req-6e50b8e7-efc5-4049-a6d3-493b6ee235de service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b1126f9-5703-4b4a-aabf-8b7d497d97ae req-6e50b8e7-efc5-4049-a6d3-493b6ee235de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b1126f9-5703-4b4a-aabf-8b7d497d97ae req-6e50b8e7-efc5-4049-a6d3-493b6ee235de service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-6b1126f9-5703-4b4a-aabf-8b7d497d97ae req-6e50b8e7-efc5-4049-a6d3-493b6ee235de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-6b1126f9-5703-4b4a-aabf-8b7d497d97ae req-6e50b8e7-efc5-4049-a6d3-493b6ee235de service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7598MB free_disk=25.769607543945312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance spawned successfully.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:32:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019169.7961442, 8938659a-310a-4050-8bf9-5febd9a53886 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:32:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] VM Started (Lifecycle Event)
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0c:63,bridge_name='br-int',has_traffic_filtering=True,id=16a63599-268a-4034-a37b-5d99d65a2656,network=Network(bdfa7369-65a3-4b4d-9037-4cc9913d3481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a63599-26') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:68:6e,bridge_name='br-int',has_traffic_filtering=True,id=cddd6045-517e-4178-87e5-a9886bcb67f8,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcddd6045-51') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:99:ab,bridge_name='br-int',has_traffic_filtering=True,id=c0850f91-2a68-4774-af40-1259366f9e60,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0850f91-2a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=51982c7d-554a-4ea1-914a-ef3819378755,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51982c7d-55') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0b:78,bridge_name='br-int',has_traffic_filtering=True,id=399eae41-8d85-43c5-91f2-accad5efad35,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399eae41-8d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=94bab03a-50c9-4b36-a064-46035b2f471b,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bab03a-50') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e0:67,bridge_name='br-int',has_traffic_filtering=True,id=a40db34b-cabb-49fe-b042-89be1390f91a,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40db34b-ca') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lazy-loading 'pci_devices' on Instance uuid 05ac30a1-7637-4346-a2ec-aa438eeef69f {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:32:50 user nova-compute[72520]:   <uuid>05ac30a1-7637-4346-a2ec-aa438eeef69f</uuid>
Aug 02 23:32:50 user nova-compute[72520]:   <name>instance-00000007</name>
Aug 02 23:32:50 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:32:50 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:32:50 user nova-compute[72520]:   <metadata>
Aug 02 23:32:50 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:32:50 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:32:50 user nova-compute[72520]:       <nova:name>tempest-device-tagging-server-984929273</nova:name>
Aug 02 23:32:50 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:32:36</nova:creationTime>
Aug 02 23:32:50 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:32:50 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:32:50 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:32:50 user nova-compute[72520]:       <nova:owner>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:user uuid="1419fb3de83c4743b688b0b3563f92da">tempest-TaggedBootDevicesTest-684754732-project-member</nova:user>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:project uuid="4859fb53c10e4bb0a81d1bf982c0ab19">tempest-TaggedBootDevicesTest-684754732</nova:project>
Aug 02 23:32:50 user nova-compute[72520]:       </nova:owner>
Aug 02 23:32:50 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:32:50 user nova-compute[72520]:       <nova:ports>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:port uuid="16a63599-268a-4034-a37b-5d99d65a2656">
Aug 02 23:32:50 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:32:50 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:port uuid="cddd6045-517e-4178-87e5-a9886bcb67f8">
Aug 02 23:32:50 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Aug 02 23:32:50 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:port uuid="c0850f91-2a68-4774-af40-1259366f9e60">
Aug 02 23:32:50 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Aug 02 23:32:50 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:port uuid="51982c7d-554a-4ea1-914a-ef3819378755">
Aug 02 23:32:50 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.235" ipVersion="4"/>
Aug 02 23:32:50 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:port uuid="399eae41-8d85-43c5-91f2-accad5efad35">
Aug 02 23:32:50 user nova-compute[72520]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Aug 02 23:32:50 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:port uuid="94bab03a-50c9-4b36-a064-46035b2f471b">
Aug 02 23:32:50 user nova-compute[72520]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 02 23:32:50 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:50 user nova-compute[72520]:         <nova:port uuid="a40db34b-cabb-49fe-b042-89be1390f91a">
Aug 02 23:32:50 user nova-compute[72520]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 02 23:32:50 user nova-compute[72520]:         </nova:port>
Aug 02 23:32:50 user nova-compute[72520]:       </nova:ports>
Aug 02 23:32:50 user nova-compute[72520]:     </nova:instance>
Aug 02 23:32:50 user nova-compute[72520]:   </metadata>
Aug 02 23:32:50 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:32:50 user nova-compute[72520]:     <system>
Aug 02 23:32:50 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:32:50 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:32:50 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:32:50 user nova-compute[72520]:       <entry name="serial">05ac30a1-7637-4346-a2ec-aa438eeef69f</entry>
Aug 02 23:32:50 user nova-compute[72520]:       <entry name="uuid">05ac30a1-7637-4346-a2ec-aa438eeef69f</entry>
Aug 02 23:32:50 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:32:50 user nova-compute[72520]:     </system>
Aug 02 23:32:50 user nova-compute[72520]:   </sysinfo>
Aug 02 23:32:50 user nova-compute[72520]:   <os>
Aug 02 23:32:50 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:32:50 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:32:50 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:32:50 user nova-compute[72520]:   </os>
Aug 02 23:32:50 user nova-compute[72520]:   <features>
Aug 02 23:32:50 user nova-compute[72520]:     <acpi/>
Aug 02 23:32:50 user nova-compute[72520]:     <apic/>
Aug 02 23:32:50 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:32:50 user nova-compute[72520]:   </features>
Aug 02 23:32:50 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:32:50 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:32:50 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:32:50 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:32:50 user nova-compute[72520]:   </clock>
Aug 02 23:32:50 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:32:50 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:32:50 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:32:50 user nova-compute[72520]:   </cpu>
Aug 02 23:32:50 user nova-compute[72520]:   <devices>
Aug 02 23:32:50 user nova-compute[72520]:     <disk type="file" device="cdrom">
Aug 02 23:32:50 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 02 23:32:50 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f/disk.config"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="hda" bus="ide"/>
Aug 02 23:32:50 user nova-compute[72520]:     </disk>
Aug 02 23:32:50 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:32:50 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:32:50 user nova-compute[72520]:       <source dev="/dev/sdc"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <serial>0ab4c557-ed85-433e-86ec-673dd7c2842e</serial>
Aug 02 23:32:50 user nova-compute[72520]:     </disk>
Aug 02 23:32:50 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:32:50 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:32:50 user nova-compute[72520]:       <source dev="/dev/sde"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <serial>887f14cb-4bd3-41d9-891f-e9cee8291b20</serial>
Aug 02 23:32:50 user nova-compute[72520]:     </disk>
Aug 02 23:32:50 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:32:50 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:32:50 user nova-compute[72520]:       <source dev="/dev/sdg"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="vdc" bus="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <serial>463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3</serial>
Aug 02 23:32:50 user nova-compute[72520]:     </disk>
Aug 02 23:32:50 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:50 user nova-compute[72520]:       <mac address="fa:16:3e:3f:0c:63"/>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="tap16a63599-26"/>
Aug 02 23:32:50 user nova-compute[72520]:     </interface>
Aug 02 23:32:50 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:50 user nova-compute[72520]:       <mac address="fa:16:3e:d1:68:6e"/>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="tapcddd6045-51"/>
Aug 02 23:32:50 user nova-compute[72520]:     </interface>
Aug 02 23:32:50 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:50 user nova-compute[72520]:       <mac address="fa:16:3e:c9:99:ab"/>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="tapc0850f91-2a"/>
Aug 02 23:32:50 user nova-compute[72520]:     </interface>
Aug 02 23:32:50 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:50 user nova-compute[72520]:       <mac address="fa:16:3e:3d:1c:d5"/>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="tap51982c7d-55"/>
Aug 02 23:32:50 user nova-compute[72520]:     </interface>
Aug 02 23:32:50 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:50 user nova-compute[72520]:       <mac address="fa:16:3e:d4:0b:78"/>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="tap399eae41-8d"/>
Aug 02 23:32:50 user nova-compute[72520]:     </interface>
Aug 02 23:32:50 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:50 user nova-compute[72520]:       <mac address="fa:16:3e:2c:52:8a"/>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="tap94bab03a-50"/>
Aug 02 23:32:50 user nova-compute[72520]:     </interface>
Aug 02 23:32:50 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:32:50 user nova-compute[72520]:       <mac address="fa:16:3e:6c:e0:67"/>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:32:50 user nova-compute[72520]:       <target dev="tapa40db34b-ca"/>
Aug 02 23:32:50 user nova-compute[72520]:     </interface>
Aug 02 23:32:50 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:32:50 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f/console.log" append="off"/>
Aug 02 23:32:50 user nova-compute[72520]:     </serial>
Aug 02 23:32:50 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:32:50 user nova-compute[72520]:     <video>
Aug 02 23:32:50 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:32:50 user nova-compute[72520]:     </video>
Aug 02 23:32:50 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:32:50 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:32:50 user nova-compute[72520]:     </rng>
Aug 02 23:32:50 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:32:50 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:32:50 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:32:50 user nova-compute[72520]:     </memballoon>
Aug 02 23:32:50 user nova-compute[72520]:   </devices>
Aug 02 23:32:50 user nova-compute[72520]: </domain>
Aug 02 23:32:50 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0c:63,bridge_name='br-int',has_traffic_filtering=True,id=16a63599-268a-4034-a37b-5d99d65a2656,network=Network(bdfa7369-65a3-4b4d-9037-4cc9913d3481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a63599-26') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0c:63,bridge_name='br-int',has_traffic_filtering=True,id=16a63599-268a-4034-a37b-5d99d65a2656,network=Network(bdfa7369-65a3-4b4d-9037-4cc9913d3481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a63599-26') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16a63599-26, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16a63599-26, col_values=(('external_ids', {'iface-id': '16a63599-268a-4034-a37b-5d99d65a2656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:0c:63', 'vm-uuid': '05ac30a1-7637-4346-a2ec-aa438eeef69f'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: INFO os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0c:63,bridge_name='br-int',has_traffic_filtering=True,id=16a63599-268a-4034-a37b-5d99d65a2656,network=Network(bdfa7369-65a3-4b4d-9037-4cc9913d3481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a63599-26')
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:68:6e,bridge_name='br-int',has_traffic_filtering=True,id=cddd6045-517e-4178-87e5-a9886bcb67f8,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcddd6045-51') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:68:6e,bridge_name='br-int',has_traffic_filtering=True,id=cddd6045-517e-4178-87e5-a9886bcb67f8,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcddd6045-51') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcddd6045-51, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcddd6045-51, col_values=(('external_ids', {'iface-id': 'cddd6045-517e-4178-87e5-a9886bcb67f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:68:6e', 'vm-uuid': '05ac30a1-7637-4346-a2ec-aa438eeef69f'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8e524afb-4d71-43a5-8b91-4f558c409237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b86f31d4-33c5-4b2b-a235-3b07b306f23a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a9fa9eda-ec05-4346-8694-89c2cd021663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 48011512-bf0e-46a2-8519-1a117fd974fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 231d5de3-cf80-43bd-90b8-58182eb36fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8938659a-310a-4050-8bf9-5febd9a53886 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:32:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: INFO os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:68:6e,bridge_name='br-int',has_traffic_filtering=True,id=cddd6045-517e-4178-87e5-a9886bcb67f8,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcddd6045-51')
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:99:ab,bridge_name='br-int',has_traffic_filtering=True,id=c0850f91-2a68-4774-af40-1259366f9e60,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0850f91-2a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:99:ab,bridge_name='br-int',has_traffic_filtering=True,id=c0850f91-2a68-4774-af40-1259366f9e60,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0850f91-2a') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0850f91-2a, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0850f91-2a, col_values=(('external_ids', {'iface-id': 'c0850f91-2a68-4774-af40-1259366f9e60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:99:ab', 'vm-uuid': '05ac30a1-7637-4346-a2ec-aa438eeef69f'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:50 user nova-compute[72520]: INFO nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Took 15.23 seconds to spawn the instance on the hypervisor.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: INFO os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:99:ab,bridge_name='br-int',has_traffic_filtering=True,id=c0850f91-2a68-4774-af40-1259366f9e60,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0850f91-2a')
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=51982c7d-554a-4ea1-914a-ef3819378755,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51982c7d-55') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=51982c7d-554a-4ea1-914a-ef3819378755,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51982c7d-55') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51982c7d-55, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51982c7d-55, col_values=(('external_ids', {'iface-id': '51982c7d-554a-4ea1-914a-ef3819378755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:1c:d5', 'vm-uuid': '05ac30a1-7637-4346-a2ec-aa438eeef69f'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: INFO os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=51982c7d-554a-4ea1-914a-ef3819378755,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51982c7d-55')
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0b:78,bridge_name='br-int',has_traffic_filtering=True,id=399eae41-8d85-43c5-91f2-accad5efad35,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399eae41-8d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0b:78,bridge_name='br-int',has_traffic_filtering=True,id=399eae41-8d85-43c5-91f2-accad5efad35,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399eae41-8d') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap399eae41-8d, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap399eae41-8d, col_values=(('external_ids', {'iface-id': '399eae41-8d85-43c5-91f2-accad5efad35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:0b:78', 'vm-uuid': '05ac30a1-7637-4346-a2ec-aa438eeef69f'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: INFO os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0b:78,bridge_name='br-int',has_traffic_filtering=True,id=399eae41-8d85-43c5-91f2-accad5efad35,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399eae41-8d')
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=94bab03a-50c9-4b36-a064-46035b2f471b,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bab03a-50') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=94bab03a-50c9-4b36-a064-46035b2f471b,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bab03a-50') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:50 user nova-compute[72520]: WARNING nova.compute.manager [req-d7d3a7ce-5434-430c-90f3-f2742efc5960 req-a0851a28-ed9b-46fc-9204-3c8929ac127e service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d for instance with vm_state building and task_state spawning.
Aug 02 23:32:50 user nova-compute[72520]: INFO nova.compute.manager [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Took 42.89 seconds to build instance.
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94bab03a-50, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94bab03a-50, col_values=(('external_ids', {'iface-id': '94bab03a-50c9-4b36-a064-46035b2f471b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:52:8a', 'vm-uuid': '05ac30a1-7637-4346-a2ec-aa438eeef69f'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b475379-5f24-4598-ba42-02f15a2c5a8e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "8938659a-310a-4050-8bf9-5febd9a53886" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.057s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:50 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:51 user nova-compute[72520]: INFO os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=94bab03a-50c9-4b36-a064-46035b2f471b,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bab03a-50')
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e0:67,bridge_name='br-int',has_traffic_filtering=True,id=a40db34b-cabb-49fe-b042-89be1390f91a,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40db34b-ca') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e0:67,bridge_name='br-int',has_traffic_filtering=True,id=a40db34b-cabb-49fe-b042-89be1390f91a,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40db34b-ca') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa40db34b-ca, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa40db34b-ca, col_values=(('external_ids', {'iface-id': 'a40db34b-cabb-49fe-b042-89be1390f91a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:e0:67', 'vm-uuid': '05ac30a1-7637-4346-a2ec-aa438eeef69f'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updated VIF entry in instance network info cache for port 471151f5-ee67-41d0-817b-333804b86f4e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updating instance_info_cache with network_info: [{"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3e19a83a-9dd2-4279-8aca-f5fb6740b364 req-347c9635-07c7-4813-8bbb-42fb171a88c3 service nova] Releasing lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:51 user nova-compute[72520]: INFO os_vif [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e0:67,bridge_name='br-int',has_traffic_filtering=True,id=a40db34b-cabb-49fe-b042-89be1390f91a,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40db34b-ca')
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updated VIF entry in instance network info cache for port 40ffeb06-6826-4533-a120-3b8d6b7570b7. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updating instance_info_cache with network_info: [{"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Releasing lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:51 user nova-compute[72520]: WARNING nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 for instance with vm_state building and task_state spawning.
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:51 user nova-compute[72520]: WARNING nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd for instance with vm_state building and task_state spawning.
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:51 user nova-compute[72520]: WARNING nova.compute.manager [req-4af99ca6-aa75-47e6-9124-0290a1064b4f req-a34b45fe-1147-4572-8c8d-ab1f92b5281c service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd for instance with vm_state building and task_state spawning.
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] No BDM found with device name hda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] No VIF found with MAC fa:16:3e:3f:0c:63, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] No VIF found with MAC fa:16:3e:d4:0b:78, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:32:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Using config drive
Aug 02 23:32:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Creating config drive at /opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f/disk.config
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm_g1bcp3 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm_g1bcp3" returned: 0 in 0.068s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-88e73c3b-ab84-4b03-929b-ec9d3320d08e req-c25170bc-c38c-47f3-abbd-a54b8d75149b service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-88e73c3b-ab84-4b03-929b-ec9d3320d08e req-c25170bc-c38c-47f3-abbd-a54b8d75149b service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-88e73c3b-ab84-4b03-929b-ec9d3320d08e req-c25170bc-c38c-47f3-abbd-a54b8d75149b service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-88e73c3b-ab84-4b03-929b-ec9d3320d08e req-c25170bc-c38c-47f3-abbd-a54b8d75149b service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-88e73c3b-ab84-4b03-929b-ec9d3320d08e req-c25170bc-c38c-47f3-abbd-a54b8d75149b service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:53 user nova-compute[72520]: WARNING nova.compute.manager [req-88e73c3b-ab84-4b03-929b-ec9d3320d08e req-c25170bc-c38c-47f3-abbd-a54b8d75149b service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 for instance with vm_state building and task_state spawning.
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-d6d197d2-781b-458d-94fd-9ec5b3fcb6a5 req-0510e8d0-5dcd-4449-9a08-a1fd28f7e1d6 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d6d197d2-781b-458d-94fd-9ec5b3fcb6a5 req-0510e8d0-5dcd-4449-9a08-a1fd28f7e1d6 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d6d197d2-781b-458d-94fd-9ec5b3fcb6a5 req-0510e8d0-5dcd-4449-9a08-a1fd28f7e1d6 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d6d197d2-781b-458d-94fd-9ec5b3fcb6a5 req-0510e8d0-5dcd-4449-9a08-a1fd28f7e1d6 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-d6d197d2-781b-458d-94fd-9ec5b3fcb6a5 req-0510e8d0-5dcd-4449-9a08-a1fd28f7e1d6 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:53 user nova-compute[72520]: WARNING nova.compute.manager [req-d6d197d2-781b-458d-94fd-9ec5b3fcb6a5 req-0510e8d0-5dcd-4449-9a08-a1fd28f7e1d6 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 for instance with vm_state building and task_state spawning.
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-b9b486cc-bd08-4f42-9ddf-eff998629b93 req-ef2effae-de0e-48d7-aa3e-b9b042a64bee service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b9b486cc-bd08-4f42-9ddf-eff998629b93 req-ef2effae-de0e-48d7-aa3e-b9b042a64bee service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b9b486cc-bd08-4f42-9ddf-eff998629b93 req-ef2effae-de0e-48d7-aa3e-b9b042a64bee service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b9b486cc-bd08-4f42-9ddf-eff998629b93 req-ef2effae-de0e-48d7-aa3e-b9b042a64bee service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-b9b486cc-bd08-4f42-9ddf-eff998629b93 req-ef2effae-de0e-48d7-aa3e-b9b042a64bee service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:54 user nova-compute[72520]: WARNING nova.compute.manager [req-b9b486cc-bd08-4f42-9ddf-eff998629b93 req-ef2effae-de0e-48d7-aa3e-b9b042a64bee service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 for instance with vm_state building and task_state spawning.
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.objects.instance [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid b86f31d4-33c5-4b2b-a235-3b07b306f23a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:55 user nova-compute[72520]: INFO nova.compute.manager [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Attaching volume 0c0069b4-fbea-48be-a3e5-0e0434bb5aca to /dev/vdb
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-ec54e1fa-bb4c-47e8-a1a4-f51384c05416 req-5bccbd8d-aecf-4527-98f0-dc545d28c8d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ec54e1fa-bb4c-47e8-a1a4-f51384c05416 req-5bccbd8d-aecf-4527-98f0-dc545d28c8d3 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ec54e1fa-bb4c-47e8-a1a4-f51384c05416 req-5bccbd8d-aecf-4527-98f0-dc545d28c8d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ec54e1fa-bb4c-47e8-a1a4-f51384c05416 req-5bccbd8d-aecf-4527-98f0-dc545d28c8d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-ec54e1fa-bb4c-47e8-a1a4-f51384c05416 req-5bccbd8d-aecf-4527-98f0-dc545d28c8d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:55 user nova-compute[72520]: WARNING nova.compute.manager [req-ec54e1fa-bb4c-47e8-a1a4-f51384c05416 req-5bccbd8d-aecf-4527-98f0-dc545d28c8d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 for instance with vm_state building and task_state spawning.
Aug 02 23:32:55 user nova-compute[72520]: DEBUG os_brick.utils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf0df3e-dea0-4128-9ed6-5dc0f203424e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9deb392-8937-4a10-a425-3c55e4fec071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c591427e-eb0b-4a5d-9653-932814173a42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8399b685-00a9-43f2-ac6f-15c5bb7973c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:55 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bc376f-02c1-4cd5-a077-6e6bc1e78d71]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG os_brick.utils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updating existing volume attachment record: e42ba1d7-4eaa-49ea-8986-826630e47b24 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:55 user nova-compute[72520]: WARNING nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 for instance with vm_state building and task_state spawning.
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:55 user nova-compute[72520]: WARNING nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 for instance with vm_state building and task_state spawning.
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:55 user nova-compute[72520]: WARNING nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 for instance with vm_state building and task_state spawning.
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:55 user nova-compute[72520]: WARNING nova.compute.manager [req-b746795f-aebd-4d25-8f47-c050a1812be5 req-097dc428-f5ae-4186-8f9b-d2c9bcab57e0 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a for instance with vm_state building and task_state spawning.
Aug 02 23:32:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:56 user nova-compute[72520]: WARNING nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 for instance with vm_state building and task_state spawning.
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:56 user nova-compute[72520]: WARNING nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 for instance with vm_state building and task_state spawning.
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:56 user nova-compute[72520]: WARNING nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 for instance with vm_state building and task_state spawning.
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:56 user nova-compute[72520]: WARNING nova.compute.manager [req-74bc4d09-4a95-4418-9af2-8115625aaaea req-17a4b0ba-6ac2-41be-b7ff-c346c9a2a3d3 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b for instance with vm_state building and task_state spawning.
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:32:56 user nova-compute[72520]: INFO nova.compute.claims [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Claim successful on node user
Aug 02 23:32:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:32:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:32:57 user nova-compute[72520]: INFO nova.virt.block_device [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Booting with volume 9b19b835-a22d-474e-9aa6-a003b53c151f at /dev/vda
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-changed-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Refreshing instance network info cache due to event network-changed-5f966658-578f-4fc0-8158-a68b0b92b3f1. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] Acquiring lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] Acquired lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Refreshing network info cache for port 5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.policy [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c16da763da24854b7921b9e9d6fe59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a3862c26eb4331b72c545cf91e3802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG os_brick.utils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e001a3b-6d2e-474f-8c7d-bac17083488e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ad937b-8f6f-4f15-87ab-83a7a3d14845]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6219afe6-10a9-46c6-92aa-81238b62abba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef469798-4150-49be-9651-17fbb17f0d12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:32:57 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:32:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[40995003-1e1f-440f-83e0-ec8c6d4bdc6a]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG os_brick.utils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updating existing volume attachment record: 587e9e78-7967-48f9-b704-b898f19a923e {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:32:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-198cac5b-f3e3-4de7-a5de-87e97ae3ce3e req-1cbcfa94-0a24-4417-9fbb-1f1df9fe2b7c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-198cac5b-f3e3-4de7-a5de-87e97ae3ce3e req-1cbcfa94-0a24-4417-9fbb-1f1df9fe2b7c service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-198cac5b-f3e3-4de7-a5de-87e97ae3ce3e req-1cbcfa94-0a24-4417-9fbb-1f1df9fe2b7c service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-198cac5b-f3e3-4de7-a5de-87e97ae3ce3e req-1cbcfa94-0a24-4417-9fbb-1f1df9fe2b7c service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-198cac5b-f3e3-4de7-a5de-87e97ae3ce3e req-1cbcfa94-0a24-4417-9fbb-1f1df9fe2b7c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:58 user nova-compute[72520]: WARNING nova.compute.manager [req-198cac5b-f3e3-4de7-a5de-87e97ae3ce3e req-1cbcfa94-0a24-4417-9fbb-1f1df9fe2b7c service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a for instance with vm_state building and task_state spawning.
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019178.1946447, 05ac30a1-7637-4346-a2ec-aa438eeef69f => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:32:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] VM Resumed (Lifecycle Event)
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:32:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance spawned successfully.
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-6cd46128-232d-4b6b-95c0-8a96ea8a460a req-7a02cf17-4f03-4edb-89dd-0f45a21ac953 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6cd46128-232d-4b6b-95c0-8a96ea8a460a req-7a02cf17-4f03-4edb-89dd-0f45a21ac953 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6cd46128-232d-4b6b-95c0-8a96ea8a460a req-7a02cf17-4f03-4edb-89dd-0f45a21ac953 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6cd46128-232d-4b6b-95c0-8a96ea8a460a req-7a02cf17-4f03-4edb-89dd-0f45a21ac953 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-6cd46128-232d-4b6b-95c0-8a96ea8a460a req-7a02cf17-4f03-4edb-89dd-0f45a21ac953 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:32:58 user nova-compute[72520]: WARNING nova.compute.manager [req-6cd46128-232d-4b6b-95c0-8a96ea8a460a req-7a02cf17-4f03-4edb-89dd-0f45a21ac953 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b for instance with vm_state building and task_state spawning.
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updated VIF entry in instance network info cache for port 5f966658-578f-4fc0-8158-a68b0b92b3f1. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updating instance_info_cache with network_info: [{"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:32:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019178.2079296, 05ac30a1-7637-4346-a2ec-aa438eeef69f => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:32:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] VM Started (Lifecycle Event)
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37baa832-ef0c-4b4e-aee7-5d46708b42fd req-8c74c8a5-cde0-4a06-a3fe-d5bcb29a272b service nova] Releasing lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:32:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:32:58 user nova-compute[72520]: INFO nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Took 22.44 seconds to spawn the instance on the hypervisor.
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Successfully created port: 35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:32:58 user nova-compute[72520]: INFO nova.compute.manager [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Took 60.13 seconds to build instance.
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-386e7b79-033d-426d-9201-09bb710eeea3 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.269s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAtLsBva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:32:58 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:58 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:32:58 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2420c74c-693f-4798-8fdb-d525e0cf6dc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:32:58 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6e0b65-6bb8-4629-b1b3-4fa108cd6951]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19] added
Aug 02 23:32:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06556fc9-9c2b-45f9-9d5d-4dc04aae9d4c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e23546b-a984-4ec6-a519-44f38ab55453]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAtLsBva {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAtLsBva" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[752305d4-4419-4146-90ce-874b6e1b77ce]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAtLsBva'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfeb63d-fc67-4748-a0c7-e251882f8bcd]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab4e52-613d-4684-88e4-4bd52e4727b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e94608-c3c9-40e4-b8e8-69c139ab3bbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260]
Aug 02 23:32:59 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260] successful.
Aug 02 23:32:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c5d179-18c6-4548-8956-91daccdbcaed]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add7d0e-6d3d-4d70-bb3c-d0443a45c4b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 (non-flash)
Aug 02 23:32:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35bf6de-d200-47ac-9061-e15631896767]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAtLsBva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Successfully updated port: 35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquired lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:32:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23234363731636337', 'path': '/dev/sdh'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234363731636337', 'path': '/dev/sdh'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lazy-loading 'flavor' on Instance uuid c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updating instance_info_cache with network_info: [{"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-changed-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Refreshing instance network info cache due to event network-changed-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] Acquiring lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:33:00 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:00 user nova-compute[72520]:   <source dev="/dev/sdh"/>
Aug 02 23:33:00 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:33:00 user nova-compute[72520]:   <serial>9e94eb19-33ff-4475-9ba2-15a078ce8a19</serial>
Aug 02 23:33:00 user nova-compute[72520]: </disk>
Aug 02 23:33:00 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Releasing lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance network_info: |[{"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] Acquired lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Refreshing network info cache for port 35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] No VIF found with MAC fa:16:3e:4f:c2:0f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updated VIF entry in instance network info cache for port 35d45074-4fe3-44a2-a7f7-9f6c4057ae4e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updating instance_info_cache with network_info: [{"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b7580f50-89bc-443f-98d2-725236e690c4 req-881f0d5c-d091-40b6-9615-870a71878633 service nova] Releasing lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-a3eb7128-cdc8-4bd8-8f1b-f13c33c0fe15 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.872s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:02 user nova-compute[72520]: INFO nova.compute.manager [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Terminating instance
Aug 02 23:33:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'flavor' on Instance uuid a9fa9eda-ec05-4346-8694-89c2cd021663 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.177s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-02e74513-7493-40d3-a8a1-66afefa09a90 req-df3bfd30-6c06-4501-851b-8ce044f5df4e service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received event network-vif-unplugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-02e74513-7493-40d3-a8a1-66afefa09a90 req-df3bfd30-6c06-4501-851b-8ce044f5df4e service nova] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-02e74513-7493-40d3-a8a1-66afefa09a90 req-df3bfd30-6c06-4501-851b-8ce044f5df4e service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-02e74513-7493-40d3-a8a1-66afefa09a90 req-df3bfd30-6c06-4501-851b-8ce044f5df4e service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-02e74513-7493-40d3-a8a1-66afefa09a90 req-df3bfd30-6c06-4501-851b-8ce044f5df4e service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] No waiting events found dispatching network-vif-unplugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-02e74513-7493-40d3-a8a1-66afefa09a90 req-df3bfd30-6c06-4501-851b-8ce044f5df4e service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received event network-vif-unplugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:33:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:03 user nova-compute[72520]: INFO nova.compute.manager [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Attaching volume a2b8d67a-b76d-4083-9e59-a82be973da52 to /dev/vdb
Aug 02 23:33:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Instance destroyed successfully.
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.objects.instance [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lazy-loading 'resources' on Instance uuid c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-276580680',display_name='tempest-DeleteServersTestJSON-server-276580680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-276580680',id=1,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:31:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6058cf02ac1547599db4ea597f94c59b',ramdisk_id='',reservation_id='r-04umk4e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1584424782',owner_user_name='tempest-DeleteServersTestJSON-1584424782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:31:05Z,user_data=None,user_id='21f7be3a14a34a5f8d6a0ea074202c7a',uuid=c33c4d73-ca9c-4af8-b38d-b8e51c1ed306,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Converting VIF {"id": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "address": "fa:16:3e:4f:c2:0f", "network": {"id": "f9eefe40-46f3-499c-882c-459688aa23eb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1898043744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6058cf02ac1547599db4ea597f94c59b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc326c462-dc", "ovs_interfaceid": "c326c462-dc1c-4bbf-bc2a-9709a9a6548b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c2:0f,bridge_name='br-int',has_traffic_filtering=True,id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b,network=Network(f9eefe40-46f3-499c-882c-459688aa23eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc326c462-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_vif [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c2:0f,bridge_name='br-int',has_traffic_filtering=True,id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b,network=Network(f9eefe40-46f3-499c-882c-459688aa23eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc326c462-dc') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc326c462-dc, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:03 user nova-compute[72520]: INFO os_vif [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c2:0f,bridge_name='br-int',has_traffic_filtering=True,id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b,network=Network(f9eefe40-46f3-499c-882c-459688aa23eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc326c462-dc')
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAtLsBva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:03 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9124ac9a-062c-4cf3-aa20-3dd1de911c8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed082bfb-f5e2-44a9-8b9a-35779e626921]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 (non-flash)
Aug 02 23:33:03 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce460df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19'): ({'sdh'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Removing single pathed devices sdh {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b780bae-c526-4d5f-8094-2efeb0172cd2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.utils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cde943-6be6-4cd3-9be9-116f829ec9a9]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Flushing IO for device /dev/sdh {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[857b5305-b66f-4336-a94d-4c5a70cf959a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1904002d-b3f0-44e2-b0fc-491e9c263183]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[766bc737-ccf7-4b1f-aab0-0751c2425414]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafa9e68-df71-45a3-81c4-5a5d976def4a]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce6e21-1809-4e39-b181-a9b3e2e89d71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] SCSI volumes sdh have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5410f6-f446-4e95-b856-b7189923efc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef1e56-920d-4b57-ac68-3191fc7167d5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:03 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95a686-07d7-410d-bd21-b71661e71478]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.utils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] <== get_connector_properties: return (223ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updating existing volume attachment record: 0df7cadc-20f5-45e2-b6c4-0d13883726c7 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f15387-aeeb-477a-ac7b-b929ae717277]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260]
Aug 02 23:33:03 user nova-compute[72520]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:03 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e94eb19-33ff-4475-9ba2-15a078ce8a19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3c8a4-bada-4b19-a808-95621d1ea95d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] <== disconnect_volume: return (421ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:33:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Deleting instance files /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306_del
Aug 02 23:33:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Deletion of /opt/stack/data/nova/instances/c33c4d73-ca9c-4af8-b38d-b8e51c1ed306_del complete
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72520) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 02 23:33:03 user nova-compute[72520]: INFO nova.virt.libvirt.host [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] UEFI support detected
Aug 02 23:33:03 user nova-compute[72520]: INFO nova.compute.manager [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Took 1.58 seconds to destroy the instance on the hypervisor.
Aug 02 23:33:03 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:33:03 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:33:04 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-a8cc1309-5b31-4875-8950-c1eb843f8e92 req-3ca35070-96b2-43f1-aeae-f90abb484d6b service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received event network-vif-deleted-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:04 user nova-compute[72520]: INFO nova.compute.manager [req-a8cc1309-5b31-4875-8950-c1eb843f8e92 req-3ca35070-96b2-43f1-aeae-f90abb484d6b service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Neutron deleted interface c326c462-dc1c-4bbf-bc2a-9709a9a6548b; detaching it from the instance and deleting it from the info cache
Aug 02 23:33:04 user nova-compute[72520]: DEBUG nova.network.neutron [req-a8cc1309-5b31-4875-8950-c1eb843f8e92 req-3ca35070-96b2-43f1-aeae-f90abb484d6b service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:04 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Took 0.78 seconds to deallocate network for instance.
Aug 02 23:33:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-a8cc1309-5b31-4875-8950-c1eb843f8e92 req-3ca35070-96b2-43f1-aeae-f90abb484d6b service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Detach interface failed, port_id=c326c462-dc1c-4bbf-bc2a-9709a9a6548b, reason: Instance c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:33:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-3b9a5a65-7ae1-403e-937a-9df0102e07bd req-badb479a-be30-4573-92bc-f7913590d4b3 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received event network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3b9a5a65-7ae1-403e-937a-9df0102e07bd req-badb479a-be30-4573-92bc-f7913590d4b3 service nova] Acquiring lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3b9a5a65-7ae1-403e-937a-9df0102e07bd req-badb479a-be30-4573-92bc-f7913590d4b3 service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3b9a5a65-7ae1-403e-937a-9df0102e07bd req-badb479a-be30-4573-92bc-f7913590d4b3 service nova] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-3b9a5a65-7ae1-403e-937a-9df0102e07bd req-badb479a-be30-4573-92bc-f7913590d4b3 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] No waiting events found dispatching network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:04 user nova-compute[72520]: WARNING nova.compute.manager [req-3b9a5a65-7ae1-403e-937a-9df0102e07bd req-badb479a-be30-4573-92bc-f7913590d4b3 service nova] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Received unexpected event network-vif-plugged-c326c462-dc1c-4bbf-bc2a-9709a9a6548b for instance with vm_state active and task_state deleting.
Aug 02 23:33:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeSOULyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:06 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:06 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:06 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8323b-f510-40d0-b791-321377d6f769]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:33:06 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2e41c-ab2b-48d3-ab3e-84268d6f86dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca] added
Aug 02 23:33:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9174457-3cb4-4c12-a340-e99a37bfae0d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fcac81-f01c-4707-841e-0757f6c64ec6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeSOULyR {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeSOULyR" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a392186-7213-435d-912f-372e9e149013]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeSOULyR'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4747fef7-b5b1-47c0-94a2-e419b41f7ea6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e8bb3d-1132-4d55-90fc-3ef00ce9fe78]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:06 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f391b4-693d-448e-a010-4f7b368fa594]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260]
Aug 02 23:33:07 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a2144b-2319-49cb-85ba-23d346257e91]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[088ab504-2295-4521-aaa1-39b3a6ccf5dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:07 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f6c26-141d-49a7-b338-475a755409f8]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeSOULyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:33:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:08 user nova-compute[72520]: INFO nova.compute.manager [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Took 3.51 seconds to detach 1 volumes for instance.
Aug 02 23:33:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23633646336616164', 'path': '/dev/sdh'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633646336616164', 'path': '/dev/sdh'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.objects.instance [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid b86f31d4-33c5-4b2b-a235-3b07b306f23a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:33:08 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:08 user nova-compute[72520]:   <source dev="/dev/sdh"/>
Aug 02 23:33:08 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:33:08 user nova-compute[72520]:   <serial>0c0069b4-fbea-48be-a3e5-0e0434bb5aca</serial>
Aug 02 23:33:08 user nova-compute[72520]: </disk>
Aug 02 23:33:08 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.632s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:08 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Deleted allocations for instance c33c4d73-ca9c-4af8-b38d-b8e51c1ed306
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No VIF found with MAC fa:16:3e:ec:eb:8b, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:33:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0283be98-b350-4661-9362-20772a405121 tempest-DeleteServersTestJSON-1584424782 tempest-DeleteServersTestJSON-1584424782-project-member] Lock "c33c4d73-ca9c-4af8-b38d-b8e51c1ed306" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.979s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69e36ef6-2172-4e5b-84bb-c65fefbfbcea tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.818s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-changed-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Refreshing instance network info cache due to event network-changed-a95ab9fc-0628-4709-b258-d73fb107be13. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:33:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] Acquiring lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] Acquired lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:11 user nova-compute[72520]: DEBUG nova.network.neutron [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Refreshing network info cache for port a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:33:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Updated VIF entry in instance network info cache for port a95ab9fc-0628-4709-b258-d73fb107be13. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:33:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Updating instance_info_cache with network_info: [{"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91a67278-bd54-40dc-9813-47dae452f500 req-4e541ce5-b4bf-4d66-af5a-20dec3308ea2 service nova] Releasing lock "refresh_cache-48011512-bf0e-46a2-8519-1a117fd974fe" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "0123787e-4684-4f17-9605-5189590901cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "0123787e-4684-4f17-9605-5189590901cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:33:14 user nova-compute[72520]: INFO nova.compute.claims [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Claim successful on node user
Aug 02 23:33:14 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:33:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:33:14 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:33:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.policy [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9f79446d734cbfa7644b128bbf5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052da981a9a4629b46fb0d3533c96c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:33:15 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Creating image(s)
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "/opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:33:15 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Creating image(s)
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Ensure instance console log exists: /opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Start _get_guest_xml network_info=[{"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00e60fe9-f01d-4b28-9870-a1c6a372d716', 'attached_at': '', 'detached_at': '', 'volume_id': '9b19b835-a22d-474e-9aa6-a003b53c151f', 'serial': '9b19b835-a22d-474e-9aa6-a003b53c151f'}, 'attachment_id': '587e9e78-7967-48f9-b704-b898f19a923e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:33:15 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:15 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.235s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:15 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:15 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:15 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2199e4e7-73c5-4c47-a567-e3bebb21e78d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:33:15 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced94f4-5318-424a-8376-f8ccd322f0b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f] added
Aug 02 23:33:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received event network-changed-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Refreshing instance network info cache due to event network-changed-895193a1-de0e-418c-871f-eab8db933ed4. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] Acquiring lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] Acquired lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.network.neutron [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Refreshing network info cache for port 895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.201s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b53d8b-f348-4886-9d41-27d2a254cf25]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk 1073741824" returned: 0 in 0.057s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d43552-aa7c-4d58-bd40-21ec21623a22]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqwaCmAF {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqwaCmAF" returned: 0 in 0.036s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b94569-d4a1-4ca9-b605-08386835e13b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OqwaCmAF'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eac17d3-ecc7-45f0-8ae4-b9cadae17f8b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[064a6315-ad9b-4574-a1b9-692b01bc6fcd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:15 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.260s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d740c-420e-4ac8-9227-f143528e6e1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lazy-loading 'flavor' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]
Aug 02 23:33:15 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG nova.network.neutron [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Successfully created port: 69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[993eb38f-f659-4c0a-a338-4f664f1f2d28]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.153s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a5a6e2-439c-454f-a8ba-92a1898e4b36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:16 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:16 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:16 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.601s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Cannot resize image /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'migration_context' on Instance uuid 0123787e-4684-4f17-9605-5189590901cf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63680ce2-3580-4887-8eec-7fef32939559]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Ensure instance console log exists: /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:16 user nova-compute[72520]: INFO nova.compute.manager [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Attaching volume 2480278e-8412-4720-a9d3-2b51566e6a42 to /dev/vdb
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.utils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae8818-2335-4095-93c0-56424248434a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a9347-ad33-480b-bb9d-74ebfbda8e1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab502320-e31e-4ac3-b19d-d4d58ad75ed8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4bac8-98d6-42e6-8130-5a3244ac3adb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:16 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:33:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d90cce-7827-41a5-9f8d-ed3f0fdad6f7]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG os_brick.utils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:16 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Updating existing volume attachment record: d2698b72-17d0-4521-8264-cf42fafe49ed {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Updated VIF entry in instance network info cache for port 895193a1-de0e-418c-871f-eab8db933ed4. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Updating instance_info_cache with network_info: [{"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7b54262-bed7-4a36-a47a-59644a918583 req-9488b136-a8cf-476c-84b2-a531e6bf12aa service nova] Releasing lock "refresh_cache-231d5de3-cf80-43bd-90b8-58182eb36fdd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Successfully updated port: 69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquired lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-changed-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Refreshing instance network info cache due to event network-changed-69147d0e-fd7d-47df-b872-750ead41f42a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] Acquiring lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.682s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] <== connect_volume: return (1685ms) {'type': 'block', 'scsi_wwn': '23233646437396439', 'path': '/dev/sdi'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233646437396439', 'path': '/dev/sdi'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1542430789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1542430789',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqvLzVCkT8bvzftZb7AMDtHeOMmBeFF4frxcylAlJx/jSrTkfK6q1ipNE5vvyJL659Jqn7d5hR74At3igrlIj99nJf8DtlmKuHNmRx79SKYiGCP4W7B16NyaDt7cZEv5Q==',key_name='tempest-keypair-57639330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-y0imkgwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=00e60fe9-f01d-4b28-9870-a1c6a372d716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'pci_devices' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:33:17 user nova-compute[72520]:   <uuid>00e60fe9-f01d-4b28-9870-a1c6a372d716</uuid>
Aug 02 23:33:17 user nova-compute[72520]:   <name>instance-00000009</name>
Aug 02 23:33:17 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:33:17 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:33:17 user nova-compute[72520]:   <metadata>
Aug 02 23:33:17 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:33:17 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1542430789</nova:name>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:33:15</nova:creationTime>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:33:17 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:33:17 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:owner>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:user uuid="5c16da763da24854b7921b9e9d6fe59e">tempest-ServerActionsV293TestJSON-1063891997-project-member</nova:user>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:project uuid="75a3862c26eb4331b72c545cf91e3802">tempest-ServerActionsV293TestJSON-1063891997</nova:project>
Aug 02 23:33:17 user nova-compute[72520]:       </nova:owner>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:ports>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:port uuid="35d45074-4fe3-44a2-a7f7-9f6c4057ae4e">
Aug 02 23:33:17 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 02 23:33:17 user nova-compute[72520]:         </nova:port>
Aug 02 23:33:17 user nova-compute[72520]:       </nova:ports>
Aug 02 23:33:17 user nova-compute[72520]:     </nova:instance>
Aug 02 23:33:17 user nova-compute[72520]:   </metadata>
Aug 02 23:33:17 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:33:17 user nova-compute[72520]:     <system>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="serial">00e60fe9-f01d-4b28-9870-a1c6a372d716</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="uuid">00e60fe9-f01d-4b28-9870-a1c6a372d716</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:33:17 user nova-compute[72520]:     </system>
Aug 02 23:33:17 user nova-compute[72520]:   </sysinfo>
Aug 02 23:33:17 user nova-compute[72520]:   <os>
Aug 02 23:33:17 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:33:17 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:33:17 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:33:17 user nova-compute[72520]:   </os>
Aug 02 23:33:17 user nova-compute[72520]:   <features>
Aug 02 23:33:17 user nova-compute[72520]:     <acpi/>
Aug 02 23:33:17 user nova-compute[72520]:     <apic/>
Aug 02 23:33:17 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:33:17 user nova-compute[72520]:   </features>
Aug 02 23:33:17 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:33:17 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:33:17 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:33:17 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:33:17 user nova-compute[72520]:   </clock>
Aug 02 23:33:17 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:33:17 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:33:17 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:33:17 user nova-compute[72520]:   </cpu>
Aug 02 23:33:17 user nova-compute[72520]:   <devices>
Aug 02 23:33:17 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:33:17 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:17 user nova-compute[72520]:       <source dev="/dev/sdi"/>
Aug 02 23:33:17 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:33:17 user nova-compute[72520]:       <serial>9b19b835-a22d-474e-9aa6-a003b53c151f</serial>
Aug 02 23:33:17 user nova-compute[72520]:     </disk>
Aug 02 23:33:17 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:33:17 user nova-compute[72520]:       <mac address="fa:16:3e:c1:eb:0f"/>
Aug 02 23:33:17 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:33:17 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:33:17 user nova-compute[72520]:       <target dev="tap35d45074-4f"/>
Aug 02 23:33:17 user nova-compute[72520]:     </interface>
Aug 02 23:33:17 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:33:17 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716/console.log" append="off"/>
Aug 02 23:33:17 user nova-compute[72520]:     </serial>
Aug 02 23:33:17 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:33:17 user nova-compute[72520]:     <video>
Aug 02 23:33:17 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:33:17 user nova-compute[72520]:     </video>
Aug 02 23:33:17 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:33:17 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:33:17 user nova-compute[72520]:     </rng>
Aug 02 23:33:17 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:33:17 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:33:17 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:33:17 user nova-compute[72520]:     </memballoon>
Aug 02 23:33:17 user nova-compute[72520]:   </devices>
Aug 02 23:33:17 user nova-compute[72520]: </domain>
Aug 02 23:33:17 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1542430789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1542430789',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqvLzVCkT8bvzftZb7AMDtHeOMmBeFF4frxcylAlJx/jSrTkfK6q1ipNE5vvyJL659Jqn7d5hR74At3igrlIj99nJf8DtlmKuHNmRx79SKYiGCP4W7B16NyaDt7cZEv5Q==',key_name='tempest-keypair-57639330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-y0imkgwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=00e60fe9-f01d-4b28-9870-a1c6a372d716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG os_vif [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d45074-4f, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35d45074-4f, col_values=(('external_ids', {'iface-id': '35d45074-4fe3-44a2-a7f7-9f6c4057ae4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:eb:0f', 'vm-uuid': '00e60fe9-f01d-4b28-9870-a1c6a372d716'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: INFO os_vif [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f')
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] No VIF found with MAC fa:16:3e:c1:eb:0f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Updating instance_info_cache with network_info: [{"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Releasing lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Instance network_info: |[{"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] Acquired lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Refreshing network info cache for port 69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Start _get_guest_xml network_info=[{"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:33:17 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:17 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-420932723',display_name='tempest-AttachVolumeNegativeTest-server-420932723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-420932723',id=10,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvVr8DSEo/giZW5x7n492KEKcFF9zE74GQTh11LuaTqrO/KrgVAsEbiBRJB+DBMXH2MYfydmqU8koivUODdAh6dgAews15UhOJaO6kwFOzl6G6pT1YNN7zH76+ORdWXug==',key_name='tempest-keypair-84727315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-8ac9p0l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=0123787e-4684-4f17-9605-5189590901cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:57,bridge_name='br-int',has_traffic_filtering=True,id=69147d0e-fd7d-47df-b872-750ead41f42a,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69147d0e-fd') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'pci_devices' on Instance uuid 0123787e-4684-4f17-9605-5189590901cf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:33:17 user nova-compute[72520]:   <uuid>0123787e-4684-4f17-9605-5189590901cf</uuid>
Aug 02 23:33:17 user nova-compute[72520]:   <name>instance-0000000a</name>
Aug 02 23:33:17 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:33:17 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:33:17 user nova-compute[72520]:   <metadata>
Aug 02 23:33:17 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:33:17 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-420932723</nova:name>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:33:17</nova:creationTime>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:33:17 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:33:17 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:owner>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:user uuid="eb9f79446d734cbfa7644b128bbf5275">tempest-AttachVolumeNegativeTest-1376380752-project-member</nova:user>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:project uuid="9052da981a9a4629b46fb0d3533c96c7">tempest-AttachVolumeNegativeTest-1376380752</nova:project>
Aug 02 23:33:17 user nova-compute[72520]:       </nova:owner>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:33:17 user nova-compute[72520]:       <nova:ports>
Aug 02 23:33:17 user nova-compute[72520]:         <nova:port uuid="69147d0e-fd7d-47df-b872-750ead41f42a">
Aug 02 23:33:17 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 02 23:33:17 user nova-compute[72520]:         </nova:port>
Aug 02 23:33:17 user nova-compute[72520]:       </nova:ports>
Aug 02 23:33:17 user nova-compute[72520]:     </nova:instance>
Aug 02 23:33:17 user nova-compute[72520]:   </metadata>
Aug 02 23:33:17 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:33:17 user nova-compute[72520]:     <system>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="serial">0123787e-4684-4f17-9605-5189590901cf</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="uuid">0123787e-4684-4f17-9605-5189590901cf</entry>
Aug 02 23:33:17 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:33:17 user nova-compute[72520]:     </system>
Aug 02 23:33:17 user nova-compute[72520]:   </sysinfo>
Aug 02 23:33:17 user nova-compute[72520]:   <os>
Aug 02 23:33:17 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:33:17 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:33:17 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:33:17 user nova-compute[72520]:   </os>
Aug 02 23:33:17 user nova-compute[72520]:   <features>
Aug 02 23:33:17 user nova-compute[72520]:     <acpi/>
Aug 02 23:33:17 user nova-compute[72520]:     <apic/>
Aug 02 23:33:17 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:33:17 user nova-compute[72520]:   </features>
Aug 02 23:33:17 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:33:17 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:33:17 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:33:17 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:33:17 user nova-compute[72520]:   </clock>
Aug 02 23:33:17 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:33:17 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:33:17 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:33:17 user nova-compute[72520]:   </cpu>
Aug 02 23:33:17 user nova-compute[72520]:   <devices>
Aug 02 23:33:17 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:33:17 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:33:17 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk"/>
Aug 02 23:33:17 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:33:17 user nova-compute[72520]:     </disk>
Aug 02 23:33:17 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:33:17 user nova-compute[72520]:       <mac address="fa:16:3e:b9:70:57"/>
Aug 02 23:33:17 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:33:17 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:33:17 user nova-compute[72520]:       <target dev="tap69147d0e-fd"/>
Aug 02 23:33:17 user nova-compute[72520]:     </interface>
Aug 02 23:33:17 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:33:17 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/console.log" append="off"/>
Aug 02 23:33:17 user nova-compute[72520]:     </serial>
Aug 02 23:33:17 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:33:17 user nova-compute[72520]:     <video>
Aug 02 23:33:17 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:33:17 user nova-compute[72520]:     </video>
Aug 02 23:33:17 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:33:17 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:33:17 user nova-compute[72520]:     </rng>
Aug 02 23:33:17 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:33:17 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:33:17 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:33:17 user nova-compute[72520]:     </memballoon>
Aug 02 23:33:17 user nova-compute[72520]:   </devices>
Aug 02 23:33:17 user nova-compute[72520]: </domain>
Aug 02 23:33:17 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-420932723',display_name='tempest-AttachVolumeNegativeTest-server-420932723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-420932723',id=10,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvVr8DSEo/giZW5x7n492KEKcFF9zE74GQTh11LuaTqrO/KrgVAsEbiBRJB+DBMXH2MYfydmqU8koivUODdAh6dgAews15UhOJaO6kwFOzl6G6pT1YNN7zH76+ORdWXug==',key_name='tempest-keypair-84727315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-8ac9p0l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=0123787e-4684-4f17-9605-5189590901cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:57,bridge_name='br-int',has_traffic_filtering=True,id=69147d0e-fd7d-47df-b872-750ead41f42a,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69147d0e-fd') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG os_vif [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:57,bridge_name='br-int',has_traffic_filtering=True,id=69147d0e-fd7d-47df-b872-750ead41f42a,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69147d0e-fd') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69147d0e-fd, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69147d0e-fd, col_values=(('external_ids', {'iface-id': '69147d0e-fd7d-47df-b872-750ead41f42a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:70:57', 'vm-uuid': '0123787e-4684-4f17-9605-5189590901cf'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:17 user nova-compute[72520]: INFO os_vif [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:57,bridge_name='br-int',has_traffic_filtering=True,id=69147d0e-fd7d-47df-b872-750ead41f42a,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69147d0e-fd')
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No VIF found with MAC fa:16:3e:b9:70:57, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:33:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:18 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019183.0750709, c33c4d73-ca9c-4af8-b38d-b8e51c1ed306 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:33:18 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] VM Stopped (Lifecycle Event)
Aug 02 23:33:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-faf96f6c-c95d-4acd-a795-82436459901e None None] [instance: c33c4d73-ca9c-4af8-b38d-b8e51c1ed306] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:33:18 user nova-compute[72520]: DEBUG nova.network.neutron [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Updated VIF entry in instance network info cache for port 69147d0e-fd7d-47df-b872-750ead41f42a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:33:18 user nova-compute[72520]: DEBUG nova.network.neutron [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Updating instance_info_cache with network_info: [{"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96dd3160-9a8a-4eb8-92b1-4cdb36d465d0 req-33e3f90a-8b3c-4e05-81fa-e3cf45215f00 service nova] Releasing lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KolQriqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:19 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9272815-fd06-4aba-96b0-5929e3f8c7a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:33:19 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f06b8af-ff39-4cab-88d7-aee4fd65e2d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52] added
Aug 02 23:33:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f81ce7-d51d-47aa-a819-bade79305bbe]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ec6c62-d1fd-40e2-93d3-bf6b210c56dd]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KolQriqT {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KolQriqT" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[62307d20-68c8-4280-8a1f-2196f2f146f1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KolQriqT'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9153b2b-bc5c-4e50-b88d-b2b2fa55f5a0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b355013f-31cd-45d6-9b8c-c03a71aca17c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e8b9d2-67ca-45e2-897c-fd88caa7241c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260]
Aug 02 23:33:19 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lazy-loading 'flavor' on Instance uuid 48011512-bf0e-46a2-8519-1a117fd974fe {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cc53cb-779a-49e9-b737-59b66d42c637]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[71056a88-76a7-4888-813d-30c8a4b75977]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:19 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf9396-8dbc-4244-a0ae-bcc87297ab3b]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KolQriqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:19 user nova-compute[72520]: INFO nova.compute.manager [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Attaching volume d133eb81-e178-4758-bed4-e6691bdefa48 to /dev/sdc
Aug 02 23:33:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.utils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a650ba-d7eb-4be2-8c83-982549f7998a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a711b-66ea-414b-a853-141e57e779c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9d351c-ec57-4065-89cd-7982e4c7a7f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f348eaf4-b51c-43ed-81e3-22ea45cf6388]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:20 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f9ca9a-fed8-4ace-b49a-1a441ce08699]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.utils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Updating existing volume attachment record: 6581e65b-c300-4d26-bb7a-300eb32a4065 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-b267f598-71c4-4e01-aa8d-fccc71dff9fa req-deb18363-01c3-447b-ab01-ec0f299cecc3 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b267f598-71c4-4e01-aa8d-fccc71dff9fa req-deb18363-01c3-447b-ab01-ec0f299cecc3 service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b267f598-71c4-4e01-aa8d-fccc71dff9fa req-deb18363-01c3-447b-ab01-ec0f299cecc3 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b267f598-71c4-4e01-aa8d-fccc71dff9fa req-deb18363-01c3-447b-ab01-ec0f299cecc3 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-b267f598-71c4-4e01-aa8d-fccc71dff9fa req-deb18363-01c3-447b-ab01-ec0f299cecc3 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:20 user nova-compute[72520]: WARNING nova.compute.manager [req-b267f598-71c4-4e01-aa8d-fccc71dff9fa req-deb18363-01c3-447b-ab01-ec0f299cecc3 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received unexpected event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with vm_state building and task_state spawning.
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '23135313336643762', 'path': '/dev/sdj'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135313336643762', 'path': '/dev/sdj'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.objects.instance [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'flavor' on Instance uuid a9fa9eda-ec05-4346-8694-89c2cd021663 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:33:20 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:20 user nova-compute[72520]:   <source dev="/dev/sdj"/>
Aug 02 23:33:20 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:33:20 user nova-compute[72520]:   <serial>a2b8d67a-b76d-4083-9e59-a82be973da52</serial>
Aug 02 23:33:20 user nova-compute[72520]: </disk>
Aug 02 23:33:20 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-f541bdd1-cbdb-457a-b6b4-2b300e8d749e req-15f2739a-81b1-43e4-9325-8707f27ddb7a service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f541bdd1-cbdb-457a-b6b4-2b300e8d749e req-15f2739a-81b1-43e4-9325-8707f27ddb7a service nova] Acquiring lock "0123787e-4684-4f17-9605-5189590901cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f541bdd1-cbdb-457a-b6b4-2b300e8d749e req-15f2739a-81b1-43e4-9325-8707f27ddb7a service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f541bdd1-cbdb-457a-b6b4-2b300e8d749e req-15f2739a-81b1-43e4-9325-8707f27ddb7a service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-f541bdd1-cbdb-457a-b6b4-2b300e8d749e req-15f2739a-81b1-43e4-9325-8707f27ddb7a service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] No waiting events found dispatching network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:20 user nova-compute[72520]: WARNING nova.compute.manager [req-f541bdd1-cbdb-457a-b6b4-2b300e8d749e req-15f2739a-81b1-43e4-9325-8707f27ddb7a service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received unexpected event network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a for instance with vm_state building and task_state spawning.
Aug 02 23:33:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] No VIF found with MAC fa:16:3e:e9:c5:49, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:33:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cefc7e30-df05-4202-9cd1-cf5d91e2dc83 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.576s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-6c6d2ea0-b6f0-425f-b0d2-2cda4b45ef79 req-cf5debd9-5fda-4eac-adc1-335b84229ed3 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6c6d2ea0-b6f0-425f-b0d2-2cda4b45ef79 req-cf5debd9-5fda-4eac-adc1-335b84229ed3 service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6c6d2ea0-b6f0-425f-b0d2-2cda4b45ef79 req-cf5debd9-5fda-4eac-adc1-335b84229ed3 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6c6d2ea0-b6f0-425f-b0d2-2cda4b45ef79 req-cf5debd9-5fda-4eac-adc1-335b84229ed3 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-6c6d2ea0-b6f0-425f-b0d2-2cda4b45ef79 req-cf5debd9-5fda-4eac-adc1-335b84229ed3 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:22 user nova-compute[72520]: WARNING nova.compute.manager [req-6c6d2ea0-b6f0-425f-b0d2-2cda4b45ef79 req-cf5debd9-5fda-4eac-adc1-335b84229ed3 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received unexpected event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with vm_state building and task_state spawning.
Aug 02 23:33:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-2377e955-2477-4ed0-9c4f-0c4af3aa5c54 req-c857e193-3c7e-4200-9155-7d47c8246ef9 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2377e955-2477-4ed0-9c4f-0c4af3aa5c54 req-c857e193-3c7e-4200-9155-7d47c8246ef9 service nova] Acquiring lock "0123787e-4684-4f17-9605-5189590901cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2377e955-2477-4ed0-9c4f-0c4af3aa5c54 req-c857e193-3c7e-4200-9155-7d47c8246ef9 service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2377e955-2477-4ed0-9c4f-0c4af3aa5c54 req-c857e193-3c7e-4200-9155-7d47c8246ef9 service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-2377e955-2477-4ed0-9c4f-0c4af3aa5c54 req-c857e193-3c7e-4200-9155-7d47c8246ef9 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] No waiting events found dispatching network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:22 user nova-compute[72520]: WARNING nova.compute.manager [req-2377e955-2477-4ed0-9c4f-0c4af3aa5c54 req-c857e193-3c7e-4200-9155-7d47c8246ef9 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received unexpected event network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a for instance with vm_state building and task_state spawning.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019203.4664223, 00e60fe9-f01d-4b28-9870-a1c6a372d716 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] VM Resumed (Lifecycle Event)
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0123787e-4684-4f17-9605-5189590901cf] Instance spawned successfully.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance spawned successfully.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019203.470293, 00e60fe9-f01d-4b28-9870-a1c6a372d716 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] VM Started (Lifecycle Event)
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019203.474484, 0123787e-4684-4f17-9605-5189590901cf => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] VM Resumed (Lifecycle Event)
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Took 8.33 seconds to spawn the instance on the hypervisor.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Took 8.57 seconds to spawn the instance on the hypervisor.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019203.4746046, 0123787e-4684-4f17-9605-5189590901cf => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] VM Started (Lifecycle Event)
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Took 27.09 seconds to build instance.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-745dad4b-0fdc-4335-92d7-9c0872ab6bc5 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.277s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:33:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Took 9.84 seconds to build instance.
Aug 02 23:33:23 user nova-compute[72520]: INFO nova.compute.manager [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Detaching volume a2b8d67a-b76d-4083-9e59-a82be973da52
Aug 02 23:33:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8eb7060d-8210-462c-acdc-a07d7a35e1ef tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "0123787e-4684-4f17-9605-5189590901cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.018s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:24 user nova-compute[72520]: INFO nova.virt.block_device [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Attempting to driver detach volume a2b8d67a-b76d-4083-9e59-a82be973da52 from mountpoint /dev/vdb
Aug 02 23:33:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Attempting to detach device vdb from instance a9fa9eda-ec05-4346-8694-89c2cd021663 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:33:24 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:24 user nova-compute[72520]:   <source dev="/dev/sdj"/>
Aug 02 23:33:24 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:33:24 user nova-compute[72520]:   <serial>a2b8d67a-b76d-4083-9e59-a82be973da52</serial>
Aug 02 23:33:24 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:33:24 user nova-compute[72520]: </disk>
Aug 02 23:33:24 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:33:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Successfully detached device vdb from instance a9fa9eda-ec05-4346-8694-89c2cd021663 from the persistent domain config.
Aug 02 23:33:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9fa9eda-ec05-4346-8694-89c2cd021663 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:33:24 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:24 user nova-compute[72520]:   <source dev="/dev/sdj"/>
Aug 02 23:33:24 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:33:24 user nova-compute[72520]:   <serial>a2b8d67a-b76d-4083-9e59-a82be973da52</serial>
Aug 02 23:33:24 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:33:24 user nova-compute[72520]: </disk>
Aug 02 23:33:24 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019204.5683415, a9fa9eda-ec05-4346-8694-89c2cd021663 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9fa9eda-ec05-4346-8694-89c2cd021663 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:33:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Successfully detached device vdb from instance a9fa9eda-ec05-4346-8694-89c2cd021663 from the live domain config.
Aug 02 23:33:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KolQriqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:24 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1d4e5-52f4-45f4-bb9f-77cd621b22bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88ccff-5b3d-4ca1-abbb-127a8233cf7f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:24 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc138790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52'): ({'sdj'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Removing single pathed devices sdj {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446d2f2-be18-43e5-9ed4-bd7790f44eab]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3454d-99e3-4752-9ec5-9b39172767f9]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Flushing IO for device /dev/sdj {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c9073b-8a3d-436a-8612-1ab7e3ab6bd4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.057s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06950fd0-4492-444d-bcb9-41cee50606f3]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] SCSI volumes sdj have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65cef57-6e29-41bf-8585-2d92311beeec]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[018420d1-9041-4e5f-b972-2d32f568f99f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260]
Aug 02 23:33:24 user nova-compute[72520]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2b8d67a-b76d-4083-9e59-a82be973da52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.063s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:25 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ffbb61-3e6e-4da5-a6dd-b0372bd30cea]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:25 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:25 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:25 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] <== disconnect_volume: return (426ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:33:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:27 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:27 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:27 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebfe8dc-e3df-4015-a9a3-9b99fbf9ed64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:33:27 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f072c69f-bf94-4c3d-9d87-850eecd57c4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42] added
Aug 02 23:33:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e158c8f0-123e-4067-903c-62652639562b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706e29c-8e69-49a8-8a6e-233f499f0f3c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtOBUNdx {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtOBUNdx" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ef1cf-d24c-4cb9-93ea-c2a3a9abdd21]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PtOBUNdx'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2a84e7-1b8a-43e0-b78d-a43841bbe9d2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce77a87-5bf7-45e5-a3e7-db3b6afb10d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:28 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:28 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[804f53fe-bbaf-461d-962e-0e4fdb5e67c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]
Aug 02 23:33:28 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:28 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1445e35-dede-4299-853e-3893593f7952]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b2fd6d-5a13-408f-9aeb-639e8bd482b8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:28 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:28 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:28 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad68c931-57be-4037-905e-8d80bc3c4899]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'flavor' on Instance uuid a9fa9eda-ec05-4346-8694-89c2cd021663 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5d5a6b7c-6bee-44e2-8bb7-478396c4cefa tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.748s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '26430373331363636', 'path': '/dev/sdj'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430373331363636', 'path': '/dev/sdj'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lazy-loading 'flavor' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:33:29 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:29 user nova-compute[72520]:   <source dev="/dev/sdj"/>
Aug 02 23:33:29 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:33:29 user nova-compute[72520]:   <serial>2480278e-8412-4720-a9d3-2b51566e6a42</serial>
Aug 02 23:33:29 user nova-compute[72520]: </disk>
Aug 02 23:33:29 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] No VIF found with MAC fa:16:3e:1b:2e:5a, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:33:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8989a527-49f8-4f75-a928-d0fde1523350 tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.981s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5775cde-9e96-45d2-a37c-0b72afed86f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e674cd48-94c2-4c4e-af06-6ca3bf96270e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f038eb56-0bfe-4776-9586-96caa8896292]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ef112-5773-44f5-9827-e69b0478e3a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:32 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:33:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1d575f-9209-4087-bf1d-c573939f0e0a]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:33:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:32 user nova-compute[72520]: INFO nova.compute.manager [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Swapping volume 2480278e-8412-4720-a9d3-2b51566e6a42 for 281f1a82-2219-40e7-a8ae-cd489d0412c2
Aug 02 23:33:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXxLInPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:34 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:34 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:34 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daf8776-7d82-4a97-90d8-b3d55ecd5af9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:33:34 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eadf1e-3594-46b7-b211-7ce4ade0ddb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48] added
Aug 02 23:33:34 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec78ef57-be57-4dff-96c1-9a589bb1eb77]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be4245b-c9e2-4fca-9ca9-07699e1f83fb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXxLInPV {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXxLInPV" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed7a5a-89d6-4a50-a049-c4e7b1dd76a1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXxLInPV'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63192f2-da50-4009-b57f-862940fad07d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ca996f-16e9-4829-9f1e-44d2fa60145d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:34 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:34 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85629cef-2db7-43ff-a77e-e8eeb258763a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260]
Aug 02 23:33:34 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:34 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bbf345-8bbd-485f-ace4-cadb00bc38fa]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53ef661-4e1d-4424-987e-84e0a5fa8687]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:34 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:34 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:34 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fd0aa9-570d-4010-b423-261b22b6c793]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:34 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXxLInPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23034343631653162', 'path': '/dev/sdk'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343631653162', 'path': '/dev/sdk'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lazy-loading 'flavor' on Instance uuid 48011512-bf0e-46a2-8519-1a117fd974fe {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:33:35 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:35 user nova-compute[72520]:   <source dev="/dev/sdk"/>
Aug 02 23:33:35 user nova-compute[72520]:   <target dev="sdc" bus="scsi"/>
Aug 02 23:33:35 user nova-compute[72520]:   <serial>d133eb81-e178-4758-bed4-e6691bdefa48</serial>
Aug 02 23:33:35 user nova-compute[72520]:   <address type="drive" controller="0" unit="2"/>
Aug 02 23:33:35 user nova-compute[72520]: </disk>
Aug 02 23:33:35 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:33:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] No BDM found with device name sda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] No VIF found with MAC fa:16:3e:6d:14:32, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:33:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d2127cc-8d69-405b-a471-2bc5b74aad7e tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.560s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:37 user nova-compute[72520]: INFO nova.compute.manager [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Detaching volume d133eb81-e178-4758-bed4-e6691bdefa48
Aug 02 23:33:37 user nova-compute[72520]: INFO nova.virt.block_device [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Attempting to driver detach volume d133eb81-e178-4758-bed4-e6691bdefa48 from mountpoint /dev/sdc
Aug 02 23:33:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Attempting to detach device sdc from instance 48011512-bf0e-46a2-8519-1a117fd974fe from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:33:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:33:37 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:37 user nova-compute[72520]:   <source dev="/dev/sdk"/>
Aug 02 23:33:37 user nova-compute[72520]:   <target dev="sdc" bus="scsi"/>
Aug 02 23:33:37 user nova-compute[72520]:   <serial>d133eb81-e178-4758-bed4-e6691bdefa48</serial>
Aug 02 23:33:37 user nova-compute[72520]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 02 23:33:37 user nova-compute[72520]: </disk>
Aug 02 23:33:37 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:33:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Successfully detached device sdc from instance 48011512-bf0e-46a2-8519-1a117fd974fe from the persistent domain config.
Aug 02 23:33:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 48011512-bf0e-46a2-8519-1a117fd974fe from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:33:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:33:37 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:37 user nova-compute[72520]:   <source dev="/dev/sdk"/>
Aug 02 23:33:37 user nova-compute[72520]:   <target dev="sdc" bus="scsi"/>
Aug 02 23:33:37 user nova-compute[72520]:   <serial>d133eb81-e178-4758-bed4-e6691bdefa48</serial>
Aug 02 23:33:37 user nova-compute[72520]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 02 23:33:37 user nova-compute[72520]: </disk>
Aug 02 23:33:37 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:33:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019218.0188034, 48011512-bf0e-46a2-8519-1a117fd974fe => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 48011512-bf0e-46a2-8519-1a117fd974fe {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:33:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Successfully detached device sdc from instance 48011512-bf0e-46a2-8519-1a117fd974fe from the live domain config.
Aug 02 23:33:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXxLInPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:38 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6667fa-f8af-4ad4-b596-473764f8f49a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f010c00e-6598-4dac-9514-890ae08bde3d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:38 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce440b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48'): ({'sdk'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Removing single pathed devices sdk {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2ccedb-0ca7-4d96-8bea-94fc3d96ebb8]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f0daf0-8865-4fb7-a58b-08f29f784e40]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Flushing IO for device /dev/sdk {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4dfce-8c19-4dfe-93cb-de9684a0aaa7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19c43c4-d904-4c35-9e39-3d97e007a5cc]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] SCSI volumes sdk have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123ee38-8652-46ad-ba6a-04def62a8f74]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d14912-0110-454c-b1c7-5802d13a8a75]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260]
Aug 02 23:33:38 user nova-compute[72520]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d133eb81-e178-4758-bed4-e6691bdefa48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf600316-c1ab-4b15-a7d3-39dde4c540df]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] <== disconnect_volume: return (375ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:33:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updating instance_info_cache with network_info: [{"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-b86f31d4-33c5-4b2b-a235-3b07b306f23a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:33:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvSpDNEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '231d5de3-cf80-43bd-90b8-58182eb36fdd', 'attached_at': '', 'detached_at': '', 'volume_id': '281f1a82-2219-40e7-a8ae-cd489d0412c2', 'serial': '281f1a82-2219-40e7-a8ae-cd489d0412c2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '231d5de3-cf80-43bd-90b8-58182eb36fdd', 'attached_at': '', 'detached_at': '', 'volume_id': '2480278e-8412-4720-a9d3-2b51566e6a42', 'serial'} {{(pid=72520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvSpDNEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:44 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[822ea8b1-3c85-4052-8f29-97122f06c63d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:33:44 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac6dfd8-23f5-4ba3-bb78-a4dd013cff30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2] added
Aug 02 23:33:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46042ae6-478d-4f3b-977a-b2ab85174a15]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74295b6-a4b8-4786-8bb6-81a2476b8ea0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvSpDNEh {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvSpDNEh" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad02ca8-32f6-418d-9477-c4593e353be6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OvSpDNEh'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:45 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:45 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7361MB free_disk=25.734901428222656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a9d1f0-84cf-4843-b89f-4a5d79259986]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f1e8f0-62f5-4a13-b820-57a53b2a5ffc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8e524afb-4d71-43a5-8b91-4f558c409237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b86f31d4-33c5-4b2b-a235-3b07b306f23a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a9fa9eda-ec05-4346-8694-89c2cd021663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 48011512-bf0e-46a2-8519-1a117fd974fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 231d5de3-cf80-43bd-90b8-58182eb36fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8938659a-310a-4050-8bf9-5febd9a53886 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 00e60fe9-f01d-4b28-9870-a1c6a372d716 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0123787e-4684-4f17-9605-5189590901cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9789dec4-3612-42c1-91fd-fb23a6abe91f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260]
Aug 02 23:33:45 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61305c-3d9f-4051-bb00-d643f23be51c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41f74e-9e03-4ba5-a595-f4100243437b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:45 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.822s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aedbad3-127f-42ec-8b7b-55235b9a4413]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvSpDNEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:33:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.objects.instance [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lazy-loading 'flavor' on Instance uuid 48011512-bf0e-46a2-8519-1a117fd974fe {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3544891c-c29c-48f0-9edd-8709d12e3a54 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.600s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:33:46 user nova-compute[72520]: INFO nova.compute.claims [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Claim successful on node user
Aug 02 23:33:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.870s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] <== connect_volume: return (1872ms) {'type': 'block', 'scsi_wwn': '23336613538396537', 'path': '/dev/sdk'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336613538396537', 'path': '/dev/sdk'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.objects.instance [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lazy-loading 'flavor' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:46 user nova-compute[72520]: INFO nova.compute.manager [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Terminating instance
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-c76671a3-3bd5-4385-860e-67293841356d req-667dc5b1-b3dc-4f9f-8a30-89b6d907028f service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-vif-unplugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c76671a3-3bd5-4385-860e-67293841356d req-667dc5b1-b3dc-4f9f-8a30-89b6d907028f service nova] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c76671a3-3bd5-4385-860e-67293841356d req-667dc5b1-b3dc-4f9f-8a30-89b6d907028f service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c76671a3-3bd5-4385-860e-67293841356d req-667dc5b1-b3dc-4f9f-8a30-89b6d907028f service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-c76671a3-3bd5-4385-860e-67293841356d req-667dc5b1-b3dc-4f9f-8a30-89b6d907028f service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] No waiting events found dispatching network-vif-unplugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-c76671a3-3bd5-4385-860e-67293841356d req-667dc5b1-b3dc-4f9f-8a30-89b6d907028f service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-vif-unplugged-a95ab9fc-0628-4709-b258-d73fb107be13 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:33:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:33:47 user nova-compute[72520]: INFO nova.virt.block_device [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Booting with volume 4202cc7f-a6ab-461f-80fd-4ca68d1d418a at /dev/vda
Aug 02 23:33:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Instance destroyed successfully.
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.objects.instance [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lazy-loading 'resources' on Instance uuid 48011512-bf0e-46a2-8519-1a117fd974fe {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.policy [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7420cb0556144b99ef811558ca21e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfc4fa5c29a48dc9021bbd09b4668f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-149293802',display_name='tempest-AttachSCSIVolumeTestJSON-server-149293802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-149293802',id=5,image_ref='9a2e6a57-a143-4c22-ab74-972e4b9a2ba9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUHKOn3unPQxkTtb20KTTU7ir/W/eefn7COkfehdPAX7z9RdMWcEXtESqUMZ1Pl6ZBbqW7xX8WbuJgEsHy8Un2oU4VQceEa/NtQgsvjOVvhLQNRdWoMnifeDAOGUAM8ww==',key_name='tempest-keypair-1498364174',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:31:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d2437b1253447ecb0dccf0fc3c42aaf',ramdisk_id='',reservation_id='r-2gygr20f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a2e6a57-a143-4c22-ab74-972e4b9a2ba9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-406649529',owner_user_name='tempest-AttachSCSIVolumeTestJSON-406649529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3cf19d1e3e4011958f3520267fec0c',uuid=48011512-bf0e-46a2-8519-1a117fd974fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Converting VIF {"id": "a95ab9fc-0628-4709-b258-d73fb107be13", "address": "fa:16:3e:6d:14:32", "network": {"id": "73eef370-2441-4c21-b234-821c0fc8b44e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1966963768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d2437b1253447ecb0dccf0fc3c42aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa95ab9fc-06", "ovs_interfaceid": "a95ab9fc-0628-4709-b258-d73fb107be13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:14:32,bridge_name='br-int',has_traffic_filtering=True,id=a95ab9fc-0628-4709-b258-d73fb107be13,network=Network(73eef370-2441-4c21-b234-821c0fc8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa95ab9fc-06') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG os_vif [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:14:32,bridge_name='br-int',has_traffic_filtering=True,id=a95ab9fc-0628-4709-b258-d73fb107be13,network=Network(73eef370-2441-4c21-b234-821c0fc8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa95ab9fc-06') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa95ab9fc-06, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:47 user nova-compute[72520]: INFO os_vif [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:14:32,bridge_name='br-int',has_traffic_filtering=True,id=a95ab9fc-0628-4709-b258-d73fb107be13,network=Network(73eef370-2441-4c21-b234-821c0fc8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa95ab9fc-06')
Aug 02 23:33:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Deleting instance files /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe_del
Aug 02 23:33:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Deletion of /opt/stack/data/nova/instances/48011512-bf0e-46a2-8519-1a117fd974fe_del complete
Aug 02 23:33:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG os_brick.utils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf12fab2-2460-4e4a-8b17-3308d8e5545f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[259170bb-1a54-4f58-9b4a-95224ec2354a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4c2b7-7336-4e48-bfda-3a61cbc69588]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a56e02-d5a3-4f3c-8c51-5c15f910f262]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:47 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f538650b-1cbc-4a55-a43d-8d893ba04333]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG os_brick.utils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating existing volume attachment record: 534d5545-7f12-4fa7-a9eb-8bec9eef758e {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:33:47 user nova-compute[72520]: INFO nova.compute.manager [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 02 23:33:47 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:33:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 260046848 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Successfully created port: af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:33:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 406847488 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-e45b0a5c-300f-4a30-89d5-7c4a5624801d req-098e79b4-3c24-4245-a888-112e56815f8f service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e45b0a5c-300f-4a30-89d5-7c4a5624801d req-098e79b4-3c24-4245-a888-112e56815f8f service nova] Acquiring lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e45b0a5c-300f-4a30-89d5-7c4a5624801d req-098e79b4-3c24-4245-a888-112e56815f8f service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e45b0a5c-300f-4a30-89d5-7c4a5624801d req-098e79b4-3c24-4245-a888-112e56815f8f service nova] Lock "48011512-bf0e-46a2-8519-1a117fd974fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-e45b0a5c-300f-4a30-89d5-7c4a5624801d req-098e79b4-3c24-4245-a888-112e56815f8f service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] No waiting events found dispatching network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:33:49 user nova-compute[72520]: WARNING nova.compute.manager [req-e45b0a5c-300f-4a30-89d5-7c4a5624801d req-098e79b4-3c24-4245-a888-112e56815f8f service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received unexpected event network-vif-plugged-a95ab9fc-0628-4709-b258-d73fb107be13 for instance with vm_state active and task_state deleting.
Aug 02 23:33:49 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:49 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Took 1.54 seconds to deallocate network for instance.
Aug 02 23:33:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-5b2cfdb0-57f6-4dac-8d17-2574cf5f5911 req-daf55247-0698-4970-9d7c-ade54e150fee service nova] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Received event network-vif-deleted-a95ab9fc-0628-4709-b258-d73fb107be13 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 577765376 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:33:49 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 680525824 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.798s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:50 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Deleted allocations for instance 48011512-bf0e-46a2-8519-1a117fd974fe
Aug 02 23:33:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e185f184-bf49-4dc4-ab97-1ad34ae84b10 tempest-AttachSCSIVolumeTestJSON-406649529 tempest-AttachSCSIVolumeTestJSON-406649529-project-member] Lock "48011512-bf0e-46a2-8519-1a117fd974fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.847s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.network.neutron [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Successfully updated port: af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.network.neutron [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing instance network info cache due to event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.network.neutron [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 822083584 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.network.neutron [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance network_info: |[{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updated VIF entry in instance network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6a3d5bf3-342d-4114-86b9-ab5c08acc16b req-7796da4d-06d6-49de-92b1-bfa34b9affd5 service nova] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:51 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f8a07b-cf2b-48e4-86cd-758ff0e8673f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fefcad38-51e0-4444-b16a-fa0b02cb9c85\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[21598b95-0003-48e1-8c5e-e1744e3a87a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fefcad38-51e0-4444-b16a-fa0b02cb9c85 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fefcad38-51e0-4444-b16a-fa0b02cb9c85 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fefcad38-51e0-4444-b16a-fa0b02cb9c85 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:51 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc139c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'): ({'sdj'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Removing single pathed devices sdj {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aea5ed7-8bc8-4091-8e2a-01732539de9b]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd33527-fc5b-434b-9ca5-ac6b1ee148fe]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Flushing IO for device /dev/sdj {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da096ce-ef57-4ef1-856e-df651d624986]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[939edfba-d387-431e-a7e8-7a51c8972458]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] SCSI volumes sdj have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75861d7-b244-4744-af9d-cb89997a3a59]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d12ca22-8de2-4692-966b-4c8d800c1e72]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]
Aug 02 23:33:51 user nova-compute[72520]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f64f04-5403-41da-be0b-d8ab73ebe9b0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] <== disconnect_volume: return (346ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvSpDNEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '231d5de3-cf80-43bd-90b8-58182eb36fdd', 'attached_at': '', 'detached_at': '', 'volume_id': '281f1a82-2219-40e7-a8ae-cd489d0412c2', 'serial'} {{(pid=72520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] swap_volume: removing Cinder connection for volume 2480278e-8412-4720-a9d3-2b51566e6a42 {{(pid=72520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] swap_volume: Updating volume 2480278e-8412-4720-a9d3-2b51566e6a42 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "OvSpDNEh", "auth_password": "KGqYCO0mHZNVyF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "281f1a82-2219-40e7-a8ae-cd489d0412c2"}, "status": "reserved", "instance": "231d5de3-cf80-43bd-90b8-58182eb36fdd", "attached_at": "", "detached_at": "", "volume_id": "281f1a82-2219-40e7-a8ae-cd489d0412c2", "serial": "281f1a82-2219-40e7-a8ae-cd489d0412c2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '281f1a82-2219-40e7-a8ae-cd489d0412c2', 'no_device': None, 'attachment_id': 'f63d6fc2-9070-48ae-9668-6ba259b8a3bf'} {{(pid=72520) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 02 23:33:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-64451ff1-e4f3-40fd-9f14-67e8218bb687 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.778s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG os_brick.utils [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a7eb85-b5cb-49b4-9597-eb6e78a79144]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c984e0-7d41-4ef0-a05d-35b26d77b89b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5fee2e-3eff-4ba5-b1fb-b3f9f77ec5f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cad330-ed00-40cb-9ca5-420884b0bf05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:33:54 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:33:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[be83c5b6-b077-460e-8783-534fe8cf5e91]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:33:54 user nova-compute[72520]: DEBUG os_brick.utils [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:54 user nova-compute[72520]: INFO nova.compute.manager [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Swapping volume 281f1a82-2219-40e7-a8ae-cd489d0412c2 for 2480278e-8412-4720-a9d3-2b51566e6a42
Aug 02 23:33:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:33:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Creating image(s)
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Ensure instance console log exists: /opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Start _get_guest_xml network_info=[{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a425b6aa-bb98-4b02-8263-571f8e1707c9', 'attached_at': '', 'detached_at': '', 'volume_id': '4202cc7f-a6ab-461f-80fd-4ca68d1d418a', 'serial': '4202cc7f-a6ab-461f-80fd-4ca68d1d418a'}, 'attachment_id': '534d5545-7f12-4fa7-a9eb-8bec9eef758e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:33:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:33:58 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:58 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:33:58 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf496e5-7d30-40d0-b694-7b810b23ab11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:33:58 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91202de-0083-421f-bba4-d6402fb41be7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a] added
Aug 02 23:33:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f20507-f1a2-477d-b82f-c5c9bc76bb84]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569b114-aca9-48c2-8bfc-ecb6222ab30e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsqTradz {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsqTradz" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6faaeda-a2e5-4467-87e5-c51d01a8f2cc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nsqTradz'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.070s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[010cdbdd-2211-41ab-8da4-b264848a8b71]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b418d8d9-663e-4ce1-9424-a8099ecabf6f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4dee2-8e02-4c3f-9371-3484f9a209ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]
Aug 02 23:33:58 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.
Aug 02 23:33:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6e20cc-55b7-46f3-b95a-940bf2d4dfb3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b2e62f-be90-406b-ba27-ec8e8d71885e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:33:58 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:33:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] HCTL ('41', '-', '-', 0) found on session 16 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2989c5b-e7a1-4d12-a2ae-2fa77ac0ae3c]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:33:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-changed-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing instance network info cache due to event network-changed-ad57f528-4885-4c3f-a879-288f26134611. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] Acquiring lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] Acquired lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Refreshing network info cache for port ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23637303865383366', 'path': '/dev/sdj'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637303865383366', 'path': '/dev/sdj'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-522014739',display_name='tempest-TestShelveInstance-server-522014739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-522014739',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJp8n8CjMYdw+emM0jJlP1dj7fHPmzowJCQY1NxYoD+ZAxLa2Nhh9dmWeHuX26M3Sx7M4UsRoHuPvqhDBTv/L1ldI7PEauy1C2jCN/2VvehlhV4D+zVTb318b3UAXM9lg==',key_name='tempest-TestShelveInstance-283917505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccfc4fa5c29a48dc9021bbd09b4668f1',ramdisk_id='',reservation_id='r-i23tzsg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-171572139',owner_user_name='tempest-TestShelveInstance-171572139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:33:47Z,user_data=None,user_id='a7420cb0556144b99ef811558ca21e17',uuid=a425b6aa-bb98-4b02-8263-571f8e1707c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converting VIF {"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.objects.instance [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'pci_devices' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:33:59 user nova-compute[72520]:   <uuid>a425b6aa-bb98-4b02-8263-571f8e1707c9</uuid>
Aug 02 23:33:59 user nova-compute[72520]:   <name>instance-0000000b</name>
Aug 02 23:33:59 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:33:59 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:33:59 user nova-compute[72520]:   <metadata>
Aug 02 23:33:59 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:33:59 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:33:59 user nova-compute[72520]:       <nova:name>tempest-TestShelveInstance-server-522014739</nova:name>
Aug 02 23:33:59 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:33:58</nova:creationTime>
Aug 02 23:33:59 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:33:59 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:33:59 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:33:59 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:33:59 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:33:59 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:33:59 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:33:59 user nova-compute[72520]:       <nova:owner>
Aug 02 23:33:59 user nova-compute[72520]:         <nova:user uuid="a7420cb0556144b99ef811558ca21e17">tempest-TestShelveInstance-171572139-project-member</nova:user>
Aug 02 23:33:59 user nova-compute[72520]:         <nova:project uuid="ccfc4fa5c29a48dc9021bbd09b4668f1">tempest-TestShelveInstance-171572139</nova:project>
Aug 02 23:33:59 user nova-compute[72520]:       </nova:owner>
Aug 02 23:33:59 user nova-compute[72520]:       <nova:ports>
Aug 02 23:33:59 user nova-compute[72520]:         <nova:port uuid="af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1">
Aug 02 23:33:59 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 02 23:33:59 user nova-compute[72520]:         </nova:port>
Aug 02 23:33:59 user nova-compute[72520]:       </nova:ports>
Aug 02 23:33:59 user nova-compute[72520]:     </nova:instance>
Aug 02 23:33:59 user nova-compute[72520]:   </metadata>
Aug 02 23:33:59 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:33:59 user nova-compute[72520]:     <system>
Aug 02 23:33:59 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:33:59 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:33:59 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:33:59 user nova-compute[72520]:       <entry name="serial">a425b6aa-bb98-4b02-8263-571f8e1707c9</entry>
Aug 02 23:33:59 user nova-compute[72520]:       <entry name="uuid">a425b6aa-bb98-4b02-8263-571f8e1707c9</entry>
Aug 02 23:33:59 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:33:59 user nova-compute[72520]:     </system>
Aug 02 23:33:59 user nova-compute[72520]:   </sysinfo>
Aug 02 23:33:59 user nova-compute[72520]:   <os>
Aug 02 23:33:59 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:33:59 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:33:59 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:33:59 user nova-compute[72520]:   </os>
Aug 02 23:33:59 user nova-compute[72520]:   <features>
Aug 02 23:33:59 user nova-compute[72520]:     <acpi/>
Aug 02 23:33:59 user nova-compute[72520]:     <apic/>
Aug 02 23:33:59 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:33:59 user nova-compute[72520]:   </features>
Aug 02 23:33:59 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:33:59 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:33:59 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:33:59 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:33:59 user nova-compute[72520]:   </clock>
Aug 02 23:33:59 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:33:59 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:33:59 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:33:59 user nova-compute[72520]:   </cpu>
Aug 02 23:33:59 user nova-compute[72520]:   <devices>
Aug 02 23:33:59 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:33:59 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:33:59 user nova-compute[72520]:       <source dev="/dev/sdj"/>
Aug 02 23:33:59 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:33:59 user nova-compute[72520]:       <serial>4202cc7f-a6ab-461f-80fd-4ca68d1d418a</serial>
Aug 02 23:33:59 user nova-compute[72520]:     </disk>
Aug 02 23:33:59 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:33:59 user nova-compute[72520]:       <mac address="fa:16:3e:7a:74:7b"/>
Aug 02 23:33:59 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:33:59 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:33:59 user nova-compute[72520]:       <target dev="tapaf7b293b-0a"/>
Aug 02 23:33:59 user nova-compute[72520]:     </interface>
Aug 02 23:33:59 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:33:59 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9/console.log" append="off"/>
Aug 02 23:33:59 user nova-compute[72520]:     </serial>
Aug 02 23:33:59 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:33:59 user nova-compute[72520]:     <video>
Aug 02 23:33:59 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:33:59 user nova-compute[72520]:     </video>
Aug 02 23:33:59 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:33:59 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:33:59 user nova-compute[72520]:     </rng>
Aug 02 23:33:59 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:33:59 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:33:59 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:33:59 user nova-compute[72520]:     </memballoon>
Aug 02 23:33:59 user nova-compute[72520]:   </devices>
Aug 02 23:33:59 user nova-compute[72520]: </domain>
Aug 02 23:33:59 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-522014739',display_name='tempest-TestShelveInstance-server-522014739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-522014739',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJp8n8CjMYdw+emM0jJlP1dj7fHPmzowJCQY1NxYoD+ZAxLa2Nhh9dmWeHuX26M3Sx7M4UsRoHuPvqhDBTv/L1ldI7PEauy1C2jCN/2VvehlhV4D+zVTb318b3UAXM9lg==',key_name='tempest-TestShelveInstance-283917505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccfc4fa5c29a48dc9021bbd09b4668f1',ramdisk_id='',reservation_id='r-i23tzsg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-171572139',owner_user_name='tempest-TestShelveInstance-171572139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:33:47Z,user_data=None,user_id='a7420cb0556144b99ef811558ca21e17',uuid=a425b6aa-bb98-4b02-8263-571f8e1707c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converting VIF {"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG os_vif [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf7b293b-0a, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf7b293b-0a, col_values=(('external_ids', {'iface-id': 'af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:74:7b', 'vm-uuid': 'a425b6aa-bb98-4b02-8263-571f8e1707c9'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:33:59 user nova-compute[72520]: INFO os_vif [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a')
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:33:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] No VIF found with MAC fa:16:3e:7a:74:7b, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:34:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updated VIF entry in instance network info cache for port ad57f528-4885-4c3f-a879-288f26134611. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:34:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fb9a3327-0651-483e-9bdc-92ecd20965c0 req-e90a92b3-595c-45b9-bdd4-97a010615dfa service nova] Releasing lock "refresh_cache-8938659a-310a-4050-8bf9-5febd9a53886" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-21f9150c-8d6e-4db3-9230-ae369a8ca94e req-53a039c2-f9a2-45c4-bf82-caf20d863d1d service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-21f9150c-8d6e-4db3-9230-ae369a8ca94e req-53a039c2-f9a2-45c4-bf82-caf20d863d1d service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-21f9150c-8d6e-4db3-9230-ae369a8ca94e req-53a039c2-f9a2-45c4-bf82-caf20d863d1d service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-21f9150c-8d6e-4db3-9230-ae369a8ca94e req-53a039c2-f9a2-45c4-bf82-caf20d863d1d service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-21f9150c-8d6e-4db3-9230-ae369a8ca94e req-53a039c2-f9a2-45c4-bf82-caf20d863d1d service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:01 user nova-compute[72520]: WARNING nova.compute.manager [req-21f9150c-8d6e-4db3-9230-ae369a8ca94e req-53a039c2-f9a2-45c4-bf82-caf20d863d1d service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received unexpected event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with vm_state building and task_state spawning.
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "8938659a-310a-4050-8bf9-5febd9a53886" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:01 user nova-compute[72520]: INFO nova.compute.manager [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Terminating instance
Aug 02 23:34:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-70f442e4-ff9b-4ff2-91de-6f0d1b68cb32 req-6bd60d9e-5990-40bd-8d2a-436ca86a4a81 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-70f442e4-ff9b-4ff2-91de-6f0d1b68cb32 req-6bd60d9e-5990-40bd-8d2a-436ca86a4a81 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-70f442e4-ff9b-4ff2-91de-6f0d1b68cb32 req-6bd60d9e-5990-40bd-8d2a-436ca86a4a81 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-70f442e4-ff9b-4ff2-91de-6f0d1b68cb32 req-6bd60d9e-5990-40bd-8d2a-436ca86a4a81 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-70f442e4-ff9b-4ff2-91de-6f0d1b68cb32 req-6bd60d9e-5990-40bd-8d2a-436ca86a4a81 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-unplugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-70f442e4-ff9b-4ff2-91de-6f0d1b68cb32 req-6bd60d9e-5990-40bd-8d2a-436ca86a4a81 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-ad57f528-4885-4c3f-a879-288f26134611 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-8b3c85ad-c851-4b10-98d1-e457c3d06153 req-8798b9df-73c8-43b0-9759-bb7fad23ff26 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8b3c85ad-c851-4b10-98d1-e457c3d06153 req-8798b9df-73c8-43b0-9759-bb7fad23ff26 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8b3c85ad-c851-4b10-98d1-e457c3d06153 req-8798b9df-73c8-43b0-9759-bb7fad23ff26 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8b3c85ad-c851-4b10-98d1-e457c3d06153 req-8798b9df-73c8-43b0-9759-bb7fad23ff26 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-8b3c85ad-c851-4b10-98d1-e457c3d06153 req-8798b9df-73c8-43b0-9759-bb7fad23ff26 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-unplugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-8b3c85ad-c851-4b10-98d1-e457c3d06153 req-8798b9df-73c8-43b0-9759-bb7fad23ff26 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019227.3393764, 48011512-bf0e-46a2-8519-1a117fd974fe => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:02 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] VM Stopped (Lifecycle Event)
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-a4973bc9-e981-4842-a854-5775ba2a91a6 None None] [instance: 48011512-bf0e-46a2-8519-1a117fd974fe] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:03 user nova-compute[72520]: WARNING nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received unexpected event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with vm_state building and task_state spawning.
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-unplugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:03 user nova-compute[72520]: WARNING nova.compute.manager [req-c556a57e-523f-4376-9b17-13a6f83d31cd req-ca375988-88ea-47d7-93ae-d31f576c5c1d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 for instance with vm_state active and task_state deleting.
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019243.8268344, a425b6aa-bb98-4b02-8263-571f8e1707c9 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:03 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] VM Resumed (Lifecycle Event)
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance spawned successfully.
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Instance destroyed successfully.
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lazy-loading 'resources' on Instance uuid 8938659a-310a-4050-8bf9-5febd9a53886 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:03 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019243.8275218, a425b6aa-bb98-4b02-8263-571f8e1707c9 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:03 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] VM Started (Lifecycle Event)
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:d9:40,bridge_name='br-int',has_traffic_filtering=True,id=ad57f528-4885-4c3f-a879-288f26134611,network=Network(d2d03904-05e8-45f4-bfb4-e07602aa9e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad57f528-48') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:d9:40,bridge_name='br-int',has_traffic_filtering=True,id=ad57f528-4885-4c3f-a879-288f26134611,network=Network(d2d03904-05e8-45f4-bfb4-e07602aa9e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad57f528-48') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad57f528-48, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: INFO os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:d9:40,bridge_name='br-int',has_traffic_filtering=True,id=ad57f528-4885-4c3f-a879-288f26134611,network=Network(d2d03904-05e8-45f4-bfb4-e07602aa9e01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad57f528-48')
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:a2:fd,bridge_name='br-int',has_traffic_filtering=True,id=b1609de7-ff62-4ae1-a664-a2c4c33be2d3,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1609de7-ff') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:a2:fd,bridge_name='br-int',has_traffic_filtering=True,id=b1609de7-ff62-4ae1-a664-a2c4c33be2d3,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1609de7-ff') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1609de7-ff, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: INFO os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:a2:fd,bridge_name='br-int',has_traffic_filtering=True,id=b1609de7-ff62-4ae1-a664-a2c4c33be2d3,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1609de7-ff')
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:5f:29,bridge_name='br-int',has_traffic_filtering=True,id=1587b21b-15d3-4ebe-8322-34fdf0762731,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1587b21b-15') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:5f:29,bridge_name='br-int',has_traffic_filtering=True,id=1587b21b-15d3-4ebe-8322-34fdf0762731,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1587b21b-15') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:04 user nova-compute[72520]: INFO nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1587b21b-15, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: INFO os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:5f:29,bridge_name='br-int',has_traffic_filtering=True,id=1587b21b-15d3-4ebe-8322-34fdf0762731,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1587b21b-15')
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:7d:29,bridge_name='br-int',has_traffic_filtering=True,id=998d8abd-dc7e-47ba-a790-438daf95dddd,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8abd-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:7d:29,bridge_name='br-int',has_traffic_filtering=True,id=998d8abd-dc7e-47ba-a790-438daf95dddd,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8abd-dc') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap998d8abd-dc, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:04 user nova-compute[72520]: INFO nova.compute.manager [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Took 17.87 seconds to build instance.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: INFO os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:7d:29,bridge_name='br-int',has_traffic_filtering=True,id=998d8abd-dc7e-47ba-a790-438daf95dddd,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8abd-dc')
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6b:8a,bridge_name='br-int',has_traffic_filtering=True,id=ea0882aa-bede-43ae-a5ce-b27b62785ba8,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0882aa-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6b:8a,bridge_name='br-int',has_traffic_filtering=True,id=ea0882aa-bede-43ae-a5ce-b27b62785ba8,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0882aa-be') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea0882aa-be, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-db92360a-aa2d-40bb-9707-56eee2896653 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.124s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-ad57f528-4885-4c3f-a879-288f26134611 for instance with vm_state active and task_state deleting.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-unplugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-1587b21b-15d3-4ebe-8322-34fdf0762731 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-1587b21b-15d3-4ebe-8322-34fdf0762731 for instance with vm_state active and task_state deleting.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-unplugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-998d8abd-dc7e-47ba-a790-438daf95dddd for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-998d8abd-dc7e-47ba-a790-438daf95dddd for instance with vm_state active and task_state deleting.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-unplugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING nova.compute.manager [req-e947d18f-c199-42e1-88f2-7abdc5a2c2e1 req-5f5c355a-88e0-47a5-b40e-923837eb5612 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-87712eb3-4e14-4c0a-97d9-e76d4c6a262d for instance with vm_state active and task_state deleting.
Aug 02 23:34:04 user nova-compute[72520]: INFO os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:6b:8a,bridge_name='br-int',has_traffic_filtering=True,id=ea0882aa-bede-43ae-a5ce-b27b62785ba8,network=Network(a705604b-f1e0-4613-80ca-0afacb8efd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0882aa-be')
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "address": "fa:16:3e:ad:c5:dd", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87712eb3-4e", "ovs_interfaceid": "87712eb3-4e14-4c0a-97d9-e76d4c6a262d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c5:dd,bridge_name='br-int',has_traffic_filtering=True,id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87712eb3-4e') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c5:dd,bridge_name='br-int',has_traffic_filtering=True,id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87712eb3-4e') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-b1609de7-ff62-4ae1-a664-a2c4c33be2d3 for instance with vm_state active and task_state deleting.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-unplugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-unplugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Acquiring lock "8938659a-310a-4050-8bf9-5febd9a53886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] Lock "8938659a-310a-4050-8bf9-5febd9a53886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] No waiting events found dispatching network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING nova.compute.manager [req-e060fbb0-6d9d-4099-9873-353324d9f268 req-5a411977-8a61-4c10-81f6-7728e44c683d service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received unexpected event network-vif-plugged-ea0882aa-bede-43ae-a5ce-b27b62785ba8 for instance with vm_state active and task_state deleting.
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87712eb3-4e, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: INFO os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c5:dd,bridge_name='br-int',has_traffic_filtering=True,id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87712eb3-4e')
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1503938434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1503938434',id=8,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ+EiycpoKXyziqkgjBv432BOldBXwhU16pELNr3mUuSlPK8T5hvNt6d/tzLaTTlQbX1v8Hxqw9sewP4G+eFWim6idve8AQDLdzJ4bDBRTaEd0FZ/oKx3m+h8Wjk8+vpA==',key_name='tempest-keypair-1792158186',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3998463a9e3e4ef2a170f8483172193b',ramdisk_id='',reservation_id='r-yv90c8vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2032203541',owner_user_name='tempest-TaggedBootDevicesTest_v242-2032203541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1bd63fb59c427b96890b3f22b78390',uuid=8938659a-310a-4050-8bf9-5febd9a53886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converting VIF {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:e1,bridge_name='br-int',has_traffic_filtering=True,id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adfdd1c-2c') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:e1,bridge_name='br-int',has_traffic_filtering=True,id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adfdd1c-2c') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2adfdd1c-2c, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:04 user nova-compute[72520]: INFO os_vif [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:e1,bridge_name='br-int',has_traffic_filtering=True,id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3,network=Network(aba97225-3963-44ef-8339-99a7e9f87b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adfdd1c-2c')
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syhRNGjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d3855a-1045-4be8-a8a2-5f7959f528b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb39e0-5a39-42a5-9cfe-75ea7b806246]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4652950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8f6c1d-bb19-4900-bae2-5495a1702185]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c76a11-3b03-4086-b6b8-7e8f8789f6f2]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47b74c-4bf1-4363-9186-430380b128ba]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0c49ba-365e-4125-a135-8b9537a7c60f]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3304d8cf-2ed1-4b8a-a672-6c8d3e87ede4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea62f2ea-e04f-4c5d-811d-01c79dd9367f]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260]
Aug 02 23:34:04 user nova-compute[72520]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b4e2c1-14dc-488c-8c92-8e4e59d24582 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c9448-40ac-49c7-a90b-21387d9986c3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== disconnect_volume: return (423ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xtlyenof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e7e83-af23-4ceb-a5fc-329c9515552a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf88f4a4-bf23-472e-976f-fee7690a4867]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:04 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d0a4e2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '231d5de3-cf80-43bd-90b8-58182eb36fdd', 'attached_at': '', 'detached_at': '', 'volume_id': '2480278e-8412-4720-a9d3-2b51566e6a42', 'serial': '2480278e-8412-4720-a9d3-2b51566e6a42'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvSpDNEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '281f1a82-2219-40e7-a8ae-cd489d0412c2'}, 'status': 'reserved', 'instance': '231d5de3-cf80-43bd-90b8-58182eb36fdd', 'attached_at': '', 'detached_at': '', 'volume_id': '281f1a82-2219-40e7-a8ae-cd489d0412c2', 'serial'} {{(pid=72520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:04 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4291a8-22e9-4734-9784-4f18711956e0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e055ca-416f-4f2d-ad3b-e4b435de22f7]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71b45d-d92f-49c0-953b-48eb9b7de4e9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d6418-3c1f-47a0-9e77-8b3c9438264f]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b6afa2-c474-4d35-a89e-85955ea167a0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6018539-2b9c-4c07-9eec-a57ed73d8441]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260]
Aug 02 23:34:05 user nova-compute[72520]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c262bf3d-60d6-4074-8737-d7b803dd45d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb3e07c-235c-4f68-be86-ae7b46a0a0f5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== disconnect_volume: return (405ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.294s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:05 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKAOFlvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86b8131-0c32-46ae-a9d7-d2bb2fe0fceb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:34:05 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e9c75f-755a-4605-9b9c-5eb4d22179d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42] added
Aug 02 23:34:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d5bf3-477f-4547-8555-0754771ffff6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cc43df-abd0-4b1c-a392-fcdff179dd88]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtOBUNdx {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtOBUNdx" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7792a151-353d-446f-897c-5a21264cebe7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PtOBUNdx'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa1099e-4330-4f70-9e77-d4c99340d983]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219e123-aa75-44b1-b1b6-dab1b245af2d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f9b2d8-6367-4f66-acd6-65667aef38f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]
Aug 02 23:34:05 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fb48eb-3589-4b2d-abbc-ad2b70391882]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92de5c7-d1b3-498e-980e-417284c0803b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:05 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c5eb59-c633-436f-a4f2-e483d49d58d4]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] <== connect_volume: return (1721ms) {'type': 'block', 'scsi_wwn': '26430373331363636', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430373331363636', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.420s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lazy-loading 'flavor' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdfc1e2-6aaa-4057-b8dc-a7ba97f9a1f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d967d9e3-a892-47b8-8234-ed00ffab8096]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:06 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce47749d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e'): ({'sdf'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Removing single pathed devices sdf {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b581a-6469-42d9-a07c-02fa06aaac0e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e111017c-0607-4588-9fda-36317583343d]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Flushing IO for device /dev/sdf {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c96dbef-cfa5-4200-b372-dc4d00a476d1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25317a1-70ad-403f-8fb3-03da36ce332b]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] SCSI volumes sdf have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442a1f4-fb97-4ec0-ba36-cc111a407822]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[482eb9ef-5afe-45f7-814b-9bbac0120457]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260]
Aug 02 23:34:07 user nova-compute[72520]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e06f2-2778-49bf-aa0f-09f7b271161e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d290ce56-cd30-4c58-a749-293f1be60daf]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] <== disconnect_volume: return (1816ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Deleting instance files /opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886_del
Aug 02 23:34:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Deletion of /opt/stack/data/nova/instances/8938659a-310a-4050-8bf9-5febd9a53886_del complete
Aug 02 23:34:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 3145728 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:07 user nova-compute[72520]: INFO nova.compute.manager [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Took 5.31 seconds to destroy the instance on the hypervisor.
Aug 02 23:34:07 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 382730240 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 512753664 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 544210944 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 704643072 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 839909376 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-1865b866-36f7-4000-807b-cdd6b9956329 req-fa54578d-8512-4777-a5a0-c58cfc65372f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-deleted-87712eb3-4e14-4c0a-97d9-e76d4c6a262d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:10 user nova-compute[72520]: INFO nova.compute.manager [req-1865b866-36f7-4000-807b-cdd6b9956329 req-fa54578d-8512-4777-a5a0-c58cfc65372f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Neutron deleted interface 87712eb3-4e14-4c0a-97d9-e76d4c6a262d; detaching it from the instance and deleting it from the info cache
Aug 02 23:34:10 user nova-compute[72520]: DEBUG nova.network.neutron [req-1865b866-36f7-4000-807b-cdd6b9956329 req-fa54578d-8512-4777-a5a0-c58cfc65372f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "address": "fa:16:3e:20:45:e1", "network": {"id": "aba97225-3963-44ef-8339-99a7e9f87b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-1314992426", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adfdd1c-2c", "ovs_interfaceid": "2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-1865b866-36f7-4000-807b-cdd6b9956329 req-fa54578d-8512-4777-a5a0-c58cfc65372f service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Detach interface failed, port_id=87712eb3-4e14-4c0a-97d9-e76d4c6a262d, reason: Instance 8938659a-310a-4050-8bf9-5febd9a53886 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:34:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 1001390080 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:34:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvSpDNEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '281f1a82-2219-40e7-a8ae-cd489d0412c2'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:11 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc00a3a9-6790-4802-a66c-06f2635688f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ae1c0d-a14a-4a9d-a6b1-62744db9fc40]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:12 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d04e99630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2'): ({'sdk'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Removing single pathed devices sdk {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[081438ee-d8b1-43ab-a586-492408ebd0af]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d91137-29c3-46b5-b98a-4ae28cabbcb8]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Flushing IO for device /dev/sdk {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944e72f-9d6d-456d-8242-d97b0490f8af]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf1523e-418c-4b1a-b25a-7d8cd6c1c922]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] SCSI volumes sdk have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[331e8fb6-b8d8-4444-abea-d078a42543a4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b6ea6-732d-4f4e-adf2-2e77288cd123]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260]
Aug 02 23:34:12 user nova-compute[72520]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281f1a82-2219-40e7-a8ae-cd489d0412c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bb6b08-0206-454d-8161-1093df3577a5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] <== disconnect_volume: return (379ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '231d5de3-cf80-43bd-90b8-58182eb36fdd', 'attached_at': '', 'detached_at': '', 'volume_id': '2480278e-8412-4720-a9d3-2b51566e6a42', 'serial'} {{(pid=72520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 02 23:34:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] swap_volume: removing Cinder connection for volume 281f1a82-2219-40e7-a8ae-cd489d0412c2 {{(pid=72520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 02 23:34:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-f00bcdbf-dc17-4947-a57b-86f18711f7ae req-394ca6b3-74dc-460e-ba54-0817deb80b9b service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-deleted-2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:13 user nova-compute[72520]: INFO nova.compute.manager [req-f00bcdbf-dc17-4947-a57b-86f18711f7ae req-394ca6b3-74dc-460e-ba54-0817deb80b9b service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Neutron deleted interface 2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3; detaching it from the instance and deleting it from the info cache
Aug 02 23:34:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-f00bcdbf-dc17-4947-a57b-86f18711f7ae req-394ca6b3-74dc-460e-ba54-0817deb80b9b service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [{"id": "ad57f528-4885-4c3f-a879-288f26134611", "address": "fa:16:3e:e4:d9:40", "network": {"id": "d2d03904-05e8-45f4-bfb4-e07602aa9e01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-67219724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad57f528-48", "ovs_interfaceid": "ad57f528-4885-4c3f-a879-288f26134611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "address": "fa:16:3e:82:a2:fd", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1609de7-ff", "ovs_interfaceid": "b1609de7-ff62-4ae1-a664-a2c4c33be2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1587b21b-15d3-4ebe-8322-34fdf0762731", "address": "fa:16:3e:3b:5f:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1587b21b-15", "ovs_interfaceid": "1587b21b-15d3-4ebe-8322-34fdf0762731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "998d8abd-dc7e-47ba-a790-438daf95dddd", "address": "fa:16:3e:77:7d:29", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8abd-dc", "ovs_interfaceid": "998d8abd-dc7e-47ba-a790-438daf95dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "address": "fa:16:3e:a3:6b:8a", "network": {"id": "a705604b-f1e0-4613-80ca-0afacb8efd4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509728137", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3998463a9e3e4ef2a170f8483172193b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0882aa-be", "ovs_interfaceid": "ea0882aa-bede-43ae-a5ce-b27b62785ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-f00bcdbf-dc17-4947-a57b-86f18711f7ae req-394ca6b3-74dc-460e-ba54-0817deb80b9b service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Detach interface failed, port_id=2adfdd1c-2ce7-4b7d-a1f3-ccf6f12507f3, reason: Instance 8938659a-310a-4050-8bf9-5febd9a53886 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:14 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Took 6.86 seconds to deallocate network for instance.
Aug 02 23:34:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] swap_volume: Updating volume 281f1a82-2219-40e7-a8ae-cd489d0412c2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "PtOBUNdx", "auth_password": "7qM5OD3mNp9bZG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "2480278e-8412-4720-a9d3-2b51566e6a42"}, "status": "reserved", "instance": "231d5de3-cf80-43bd-90b8-58182eb36fdd", "attached_at": "", "detached_at": "", "volume_id": "2480278e-8412-4720-a9d3-2b51566e6a42", "serial": "2480278e-8412-4720-a9d3-2b51566e6a42"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2480278e-8412-4720-a9d3-2b51566e6a42', 'no_device': None, 'attachment_id': 'b5fef2d1-0c01-445f-9792-ed1da307a242'} {{(pid=72520) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 02 23:34:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6eafea13-5792-4730-b8f5-de23ca174fa8 tempest-TestVolumeSwap-1121601837 tempest-TestVolumeSwap-1121601837-project-admin] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.387s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-ebc2ff1d-5d4d-48ec-bd3d-fbb20c82310d req-7dcfba3b-25f6-4dc7-8f21-612d18ec1a41 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-deleted-ad57f528-4885-4c3f-a879-288f26134611 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-ebc2ff1d-5d4d-48ec-bd3d-fbb20c82310d req-7dcfba3b-25f6-4dc7-8f21-612d18ec1a41 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-deleted-ea0882aa-bede-43ae-a5ce-b27b62785ba8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-ebc2ff1d-5d4d-48ec-bd3d-fbb20c82310d req-7dcfba3b-25f6-4dc7-8f21-612d18ec1a41 service nova] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Received event network-vif-deleted-998d8abd-dc7e-47ba-a790-438daf95dddd {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "049ff42c-34d8-4077-b995-537d58ccc8bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:34:15 user nova-compute[72520]: INFO nova.compute.claims [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Claim successful on node user
Aug 02 23:34:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:15 user nova-compute[72520]: INFO nova.compute.manager [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Detaching volume 2480278e-8412-4720-a9d3-2b51566e6a42
Aug 02 23:34:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:16 user nova-compute[72520]: INFO nova.virt.block_device [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Attempting to driver detach volume 2480278e-8412-4720-a9d3-2b51566e6a42 from mountpoint /dev/vdb
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Attempting to detach device vdb from instance 231d5de3-cf80-43bd-90b8-58182eb36fdd from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:34:16 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:34:16 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:34:16 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:34:16 user nova-compute[72520]:   <serial>2480278e-8412-4720-a9d3-2b51566e6a42</serial>
Aug 02 23:34:16 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:34:16 user nova-compute[72520]: </disk>
Aug 02 23:34:16 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:34:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Successfully detached device vdb from instance 231d5de3-cf80-43bd-90b8-58182eb36fdd from the persistent domain config.
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 231d5de3-cf80-43bd-90b8-58182eb36fdd from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:34:16 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:34:16 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:34:16 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:34:16 user nova-compute[72520]:   <serial>2480278e-8412-4720-a9d3-2b51566e6a42</serial>
Aug 02 23:34:16 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:34:16 user nova-compute[72520]: </disk>
Aug 02 23:34:16 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:34:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.policy [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc828569cbd645fab326233e841d2494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3748be8ace1d41ba8508d59f8f8373d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:34:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Creating image(s)
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "/opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "/opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "/opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019256.5691764, 231d5de3-cf80-43bd-90b8-58182eb36fdd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:34:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Successfully detached device vdb from instance 231d5de3-cf80-43bd-90b8-58182eb36fdd from the live domain config.
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtOBUNdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '2480278e-8412-4720-a9d3-2b51566e6a42'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:16 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33102f18-a480-4683-963e-d4ac5c81f02c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca62981-6633-45c1-b412-82f76340607b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:16 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:16 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:16 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4653d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.166s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfb38af-b712-40ce-a858-73232d3b413c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d2e3a-a8be-43d0-8b1d-8d4492ad6165]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk 1073741824" returned: 0 in 0.101s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe70b42-2af5-4621-be24-cbb6b90b05b5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26b9411-8bda-4355-80a7-9b1dd76ed0d4]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e68ccd-4144-40aa-834c-700d08422c8f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:34:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2111b7-a922-4a23-ae34-2d4ad70630fe]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260]
Aug 02 23:34:17 user nova-compute[72520]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Successfully created port: 6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2480278e-8412-4720-a9d3-2b51566e6a42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[745de56c-4221-420c-ba75-6870aeb534a3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.493s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] <== disconnect_volume: return (495ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Cannot resize image /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'migration_context' on Instance uuid 049ff42c-34d8-4077-b995-537d58ccc8bd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Ensure instance console log exists: /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Successfully updated port: 6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "refresh_cache-049ff42c-34d8-4077-b995-537d58ccc8bd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquired lock "refresh_cache-049ff42c-34d8-4077-b995-537d58ccc8bd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.compute.manager [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received event network-changed-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.compute.manager [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Refreshing instance network info cache due to event network-changed-6cbc5593-aa72-4cfe-8d15-4c7c99618b07. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] Acquiring lock "refresh_cache-049ff42c-34d8-4077-b995-537d58ccc8bd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lazy-loading 'flavor' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-09534f2f-58f5-491d-8226-00e451ac614a tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.137s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Updating instance_info_cache with network_info: [{"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Releasing lock "refresh_cache-049ff42c-34d8-4077-b995-537d58ccc8bd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Instance network_info: |[{"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] Acquired lock "refresh_cache-049ff42c-34d8-4077-b995-537d58ccc8bd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.network.neutron [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Refreshing network info cache for port 6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Start _get_guest_xml network_info=[{"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:34:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-347882388',display_name='tempest-VolumesAdminNegativeTest-server-347882388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-347882388',id=12,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3748be8ace1d41ba8508d59f8f8373d8',ramdisk_id='',reservation_id='r-wnnawdsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-662521094',owner_user_name='tempest-VolumesAdminNegativeTest-662521094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:34:16Z,user_data=None,user_id='cc828569cbd645fab326233e841d2494',uuid=049ff42c-34d8-4077-b995-537d58ccc8bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converting VIF {"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=6cbc5593-aa72-4cfe-8d15-4c7c99618b07,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc5593-aa') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'pci_devices' on Instance uuid 049ff42c-34d8-4077-b995-537d58ccc8bd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:34:18 user nova-compute[72520]:   <uuid>049ff42c-34d8-4077-b995-537d58ccc8bd</uuid>
Aug 02 23:34:18 user nova-compute[72520]:   <name>instance-0000000c</name>
Aug 02 23:34:18 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:34:18 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:34:18 user nova-compute[72520]:   <metadata>
Aug 02 23:34:18 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:34:18 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:34:18 user nova-compute[72520]:       <nova:name>tempest-VolumesAdminNegativeTest-server-347882388</nova:name>
Aug 02 23:34:18 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:34:18</nova:creationTime>
Aug 02 23:34:18 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:34:18 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:34:18 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:34:18 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:34:18 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:34:18 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:34:18 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:34:18 user nova-compute[72520]:       <nova:owner>
Aug 02 23:34:18 user nova-compute[72520]:         <nova:user uuid="cc828569cbd645fab326233e841d2494">tempest-VolumesAdminNegativeTest-662521094-project-member</nova:user>
Aug 02 23:34:18 user nova-compute[72520]:         <nova:project uuid="3748be8ace1d41ba8508d59f8f8373d8">tempest-VolumesAdminNegativeTest-662521094</nova:project>
Aug 02 23:34:18 user nova-compute[72520]:       </nova:owner>
Aug 02 23:34:18 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:34:18 user nova-compute[72520]:       <nova:ports>
Aug 02 23:34:18 user nova-compute[72520]:         <nova:port uuid="6cbc5593-aa72-4cfe-8d15-4c7c99618b07">
Aug 02 23:34:18 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 02 23:34:18 user nova-compute[72520]:         </nova:port>
Aug 02 23:34:18 user nova-compute[72520]:       </nova:ports>
Aug 02 23:34:18 user nova-compute[72520]:     </nova:instance>
Aug 02 23:34:18 user nova-compute[72520]:   </metadata>
Aug 02 23:34:18 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:34:18 user nova-compute[72520]:     <system>
Aug 02 23:34:18 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:34:18 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:34:18 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:34:18 user nova-compute[72520]:       <entry name="serial">049ff42c-34d8-4077-b995-537d58ccc8bd</entry>
Aug 02 23:34:18 user nova-compute[72520]:       <entry name="uuid">049ff42c-34d8-4077-b995-537d58ccc8bd</entry>
Aug 02 23:34:18 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:34:18 user nova-compute[72520]:     </system>
Aug 02 23:34:18 user nova-compute[72520]:   </sysinfo>
Aug 02 23:34:18 user nova-compute[72520]:   <os>
Aug 02 23:34:18 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:34:18 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:34:18 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:34:18 user nova-compute[72520]:   </os>
Aug 02 23:34:18 user nova-compute[72520]:   <features>
Aug 02 23:34:18 user nova-compute[72520]:     <acpi/>
Aug 02 23:34:18 user nova-compute[72520]:     <apic/>
Aug 02 23:34:18 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:34:18 user nova-compute[72520]:   </features>
Aug 02 23:34:18 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:34:18 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:34:18 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:34:18 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:34:18 user nova-compute[72520]:   </clock>
Aug 02 23:34:18 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:34:18 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:34:18 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:34:18 user nova-compute[72520]:   </cpu>
Aug 02 23:34:18 user nova-compute[72520]:   <devices>
Aug 02 23:34:18 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:34:18 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:34:18 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk"/>
Aug 02 23:34:18 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:34:18 user nova-compute[72520]:     </disk>
Aug 02 23:34:18 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:34:18 user nova-compute[72520]:       <mac address="fa:16:3e:7a:ab:56"/>
Aug 02 23:34:18 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:34:18 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:34:18 user nova-compute[72520]:       <target dev="tap6cbc5593-aa"/>
Aug 02 23:34:18 user nova-compute[72520]:     </interface>
Aug 02 23:34:18 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:34:18 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/console.log" append="off"/>
Aug 02 23:34:18 user nova-compute[72520]:     </serial>
Aug 02 23:34:18 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:34:18 user nova-compute[72520]:     <video>
Aug 02 23:34:18 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:34:18 user nova-compute[72520]:     </video>
Aug 02 23:34:18 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:34:18 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:34:18 user nova-compute[72520]:     </rng>
Aug 02 23:34:18 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:34:18 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:34:18 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:34:18 user nova-compute[72520]:     </memballoon>
Aug 02 23:34:18 user nova-compute[72520]:   </devices>
Aug 02 23:34:18 user nova-compute[72520]: </domain>
Aug 02 23:34:18 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-347882388',display_name='tempest-VolumesAdminNegativeTest-server-347882388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-347882388',id=12,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3748be8ace1d41ba8508d59f8f8373d8',ramdisk_id='',reservation_id='r-wnnawdsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-662521094',owner_user_name='tempest-VolumesAdminNegativeTest-662521094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:34:16Z,user_data=None,user_id='cc828569cbd645fab326233e841d2494',uuid=049ff42c-34d8-4077-b995-537d58ccc8bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converting VIF {"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=6cbc5593-aa72-4cfe-8d15-4c7c99618b07,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc5593-aa') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG os_vif [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=6cbc5593-aa72-4cfe-8d15-4c7c99618b07,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc5593-aa') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cbc5593-aa, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cbc5593-aa, col_values=(('external_ids', {'iface-id': '6cbc5593-aa72-4cfe-8d15-4c7c99618b07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ab:56', 'vm-uuid': '049ff42c-34d8-4077-b995-537d58ccc8bd'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:18 user nova-compute[72520]: INFO os_vif [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=6cbc5593-aa72-4cfe-8d15-4c7c99618b07,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc5593-aa')
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:34:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] No VIF found with MAC fa:16:3e:7a:ab:56, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:34:19 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019243.9081547, 8938659a-310a-4050-8bf9-5febd9a53886 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:19 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] VM Stopped (Lifecycle Event)
Aug 02 23:34:19 user nova-compute[72520]: DEBUG nova.compute.manager [None req-54579b23-20f3-429e-bcf8-94f5c39e99a7 None None] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Updated VIF entry in instance network info cache for port 6cbc5593-aa72-4cfe-8d15-4c7c99618b07. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:34:19 user nova-compute[72520]: DEBUG nova.network.neutron [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Updating instance_info_cache with network_info: [{"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-641f0463-82ba-46fa-aedf-00e5ed2b3bd3 req-fde15a7a-64b4-4376-943e-2b1bbf7d5831 service nova] Releasing lock "refresh_cache-049ff42c-34d8-4077-b995-537d58ccc8bd" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-606063ba-c728-40a9-b8a1-f940173b08b0 req-98c24633-630a-4ea2-9d40-de8b48a6d9a3 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received event network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-606063ba-c728-40a9-b8a1-f940173b08b0 req-98c24633-630a-4ea2-9d40-de8b48a6d9a3 service nova] Acquiring lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-606063ba-c728-40a9-b8a1-f940173b08b0 req-98c24633-630a-4ea2-9d40-de8b48a6d9a3 service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-606063ba-c728-40a9-b8a1-f940173b08b0 req-98c24633-630a-4ea2-9d40-de8b48a6d9a3 service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-606063ba-c728-40a9-b8a1-f940173b08b0 req-98c24633-630a-4ea2-9d40-de8b48a6d9a3 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] No waiting events found dispatching network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:20 user nova-compute[72520]: WARNING nova.compute.manager [req-606063ba-c728-40a9-b8a1-f940173b08b0 req-98c24633-630a-4ea2-9d40-de8b48a6d9a3 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received unexpected event network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 for instance with vm_state building and task_state spawning.
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019262.3237202, 049ff42c-34d8-4077-b995-537d58ccc8bd => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:22 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] VM Resumed (Lifecycle Event)
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:34:22 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Instance spawned successfully.
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:22 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019262.327503, 049ff42c-34d8-4077-b995-537d58ccc8bd => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:22 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] VM Started (Lifecycle Event)
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:22 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:22 user nova-compute[72520]: INFO nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:22 user nova-compute[72520]: INFO nova.compute.manager [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Took 7.00 seconds to build instance.
Aug 02 23:34:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f4108320-8252-40c3-8ff8-b80bfe1c7ef4 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.131s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-933cfade-df13-42be-9ab8-34e207495099 req-7200e05c-c845-4bc6-a09b-38700077b66e service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received event network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-933cfade-df13-42be-9ab8-34e207495099 req-7200e05c-c845-4bc6-a09b-38700077b66e service nova] Acquiring lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-933cfade-df13-42be-9ab8-34e207495099 req-7200e05c-c845-4bc6-a09b-38700077b66e service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-933cfade-df13-42be-9ab8-34e207495099 req-7200e05c-c845-4bc6-a09b-38700077b66e service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-933cfade-df13-42be-9ab8-34e207495099 req-7200e05c-c845-4bc6-a09b-38700077b66e service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] No waiting events found dispatching network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:22 user nova-compute[72520]: WARNING nova.compute.manager [req-933cfade-df13-42be-9ab8-34e207495099 req-7200e05c-c845-4bc6-a09b-38700077b66e service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received unexpected event network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 for instance with vm_state active and task_state None.
Aug 02 23:34:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:27 user nova-compute[72520]: INFO nova.compute.manager [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] [instance: 8938659a-310a-4050-8bf9-5febd9a53886] Took 13.01 seconds to detach 3 volumes for instance.
Aug 02 23:34:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:27 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:34:27 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:34:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:27 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Deleted allocations for instance 8938659a-310a-4050-8bf9-5febd9a53886
Aug 02 23:34:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2a3f9861-d63f-49f5-a2a5-929a7a83ac9e tempest-TaggedBootDevicesTest_v242-2032203541 tempest-TaggedBootDevicesTest_v242-2032203541-project-member] Lock "8938659a-310a-4050-8bf9-5febd9a53886" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 25.895s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:34:38 user nova-compute[72520]: INFO nova.compute.claims [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Claim successful on node user
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:34:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:34:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Creating image(s)
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.022s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updating instance_info_cache with network_info: [{"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.policy [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbb520874684447d8894c00ae4f5359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f9e2d14a0b4abab0b07d282a808c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a9fa9eda-ec05-4346-8694-89c2cd021663" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk 1073741824" returned: 0 in 0.048s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:34:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Cannot resize image /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG nova.objects.instance [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'migration_context' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Ensure instance console log exists: /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Successfully created port: dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-changed-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing instance network info cache due to event network-changed-16a63599-268a-4034-a37b-5d99d65a2656. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] Acquiring lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] Acquired lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Refreshing network info cache for port 16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:34:41 user nova-compute[72520]: INFO nova.compute.claims [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Claim successful on node user
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:34:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:34:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Successfully updated port: dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquired lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:34:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Creating image(s)
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "/opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "/opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.policy [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16f0fc0765614221bc3599360bff975e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0eccad94f3476680dbb44bc77656e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.neutron [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updated VIF entry in instance network info cache for port 16a63599-268a-4034-a37b-5d99d65a2656. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.neutron [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk 1073741824" returned: 0 in 0.064s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2b000c2-364d-4dd6-b34f-2e3d43e734d4 req-f0721560-3d1d-4c48-9bc8-210a235ece11 service nova] Releasing lock "refresh_cache-05ac30a1-7637-4346-a2ec-aa438eeef69f" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Releasing lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Instance network_info: |[{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Start _get_guest_xml network_info=[{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:34:42 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:42 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converting VIF {"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:74:e4,bridge_name='br-int',has_traffic_filtering=True,id=dfa77141-b84f-4751-9f42-f6678520df71,network=Network(524c81bf-0097-4ccd-a55e-4c5ef4d4a16f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa77141-b8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.186s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:34:42 user nova-compute[72520]:   <uuid>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</uuid>
Aug 02 23:34:42 user nova-compute[72520]:   <name>instance-0000000d</name>
Aug 02 23:34:42 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:34:42 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:34:42 user nova-compute[72520]:   <metadata>
Aug 02 23:34:42 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:34:42 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:34:42 user nova-compute[72520]:       <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:34:42 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:34:42</nova:creationTime>
Aug 02 23:34:42 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:34:42 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:34:42 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:34:42 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:34:42 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:34:42 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:34:42 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:34:42 user nova-compute[72520]:       <nova:owner>
Aug 02 23:34:42 user nova-compute[72520]:         <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:34:42 user nova-compute[72520]:         <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:34:42 user nova-compute[72520]:       </nova:owner>
Aug 02 23:34:42 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:34:42 user nova-compute[72520]:       <nova:ports>
Aug 02 23:34:42 user nova-compute[72520]:         <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:34:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:34:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:34:42 user nova-compute[72520]:       </nova:ports>
Aug 02 23:34:42 user nova-compute[72520]:     </nova:instance>
Aug 02 23:34:42 user nova-compute[72520]:   </metadata>
Aug 02 23:34:42 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:34:42 user nova-compute[72520]:     <system>
Aug 02 23:34:42 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:34:42 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:34:42 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:34:42 user nova-compute[72520]:       <entry name="serial">1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:34:42 user nova-compute[72520]:       <entry name="uuid">1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:34:42 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:34:42 user nova-compute[72520]:     </system>
Aug 02 23:34:42 user nova-compute[72520]:   </sysinfo>
Aug 02 23:34:42 user nova-compute[72520]:   <os>
Aug 02 23:34:42 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:34:42 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:34:42 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:34:42 user nova-compute[72520]:   </os>
Aug 02 23:34:42 user nova-compute[72520]:   <features>
Aug 02 23:34:42 user nova-compute[72520]:     <acpi/>
Aug 02 23:34:42 user nova-compute[72520]:     <apic/>
Aug 02 23:34:42 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:34:42 user nova-compute[72520]:   </features>
Aug 02 23:34:42 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:34:42 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:34:42 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:34:42 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:34:42 user nova-compute[72520]:   </clock>
Aug 02 23:34:42 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:34:42 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:34:42 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:34:42 user nova-compute[72520]:   </cpu>
Aug 02 23:34:42 user nova-compute[72520]:   <devices>
Aug 02 23:34:42 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:34:42 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:34:42 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk"/>
Aug 02 23:34:42 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:34:42 user nova-compute[72520]:     </disk>
Aug 02 23:34:42 user nova-compute[72520]:     <disk type="file" device="cdrom">
Aug 02 23:34:42 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 02 23:34:42 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config"/>
Aug 02 23:34:42 user nova-compute[72520]:       <target dev="hda" bus="ide"/>
Aug 02 23:34:42 user nova-compute[72520]:     </disk>
Aug 02 23:34:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:34:42 user nova-compute[72520]:       <mac address="fa:16:3e:65:74:e4"/>
Aug 02 23:34:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:34:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:34:42 user nova-compute[72520]:       <target dev="tapdfa77141-b8"/>
Aug 02 23:34:42 user nova-compute[72520]:     </interface>
Aug 02 23:34:42 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:34:42 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log" append="off"/>
Aug 02 23:34:42 user nova-compute[72520]:     </serial>
Aug 02 23:34:42 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:34:42 user nova-compute[72520]:     <video>
Aug 02 23:34:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:34:42 user nova-compute[72520]:     </video>
Aug 02 23:34:42 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:34:42 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:34:42 user nova-compute[72520]:     </rng>
Aug 02 23:34:42 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:34:42 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:34:42 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:34:42 user nova-compute[72520]:     </memballoon>
Aug 02 23:34:42 user nova-compute[72520]:   </devices>
Aug 02 23:34:42 user nova-compute[72520]: </domain>
Aug 02 23:34:42 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converting VIF {"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:74:e4,bridge_name='br-int',has_traffic_filtering=True,id=dfa77141-b84f-4751-9f42-f6678520df71,network=Network(524c81bf-0097-4ccd-a55e-4c5ef4d4a16f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa77141-b8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG os_vif [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:74:e4,bridge_name='br-int',has_traffic_filtering=True,id=dfa77141-b84f-4751-9f42-f6678520df71,network=Network(524c81bf-0097-4ccd-a55e-4c5ef4d4a16f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa77141-b8') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfa77141-b8, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfa77141-b8, col_values=(('external_ids', {'iface-id': 'dfa77141-b84f-4751-9f42-f6678520df71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:74:e4', 'vm-uuid': '1c3580dd-23d0-4402-9a56-730e4c9f4bf8'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:42 user nova-compute[72520]: INFO os_vif [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:74:e4,bridge_name='br-int',has_traffic_filtering=True,id=dfa77141-b84f-4751-9f42-f6678520df71,network=Network(524c81bf-0097-4ccd-a55e-4c5ef4d4a16f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa77141-b8')
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Cannot resize image /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'migration_context' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Ensure instance console log exists: /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No BDM found with device name hda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:34:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No VIF found with MAC fa:16:3e:65:74:e4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:34:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Using config drive
Aug 02 23:34:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Creating config drive at /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config
Aug 02 23:34:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3n0d4ty5 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3n0d4ty5" returned: 0 in 0.095s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Successfully created port: e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-changed-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Refreshing instance network info cache due to event network-changed-dfa77141-b84f-4751-9f42-f6678520df71. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] Acquiring lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] Acquired lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Refreshing network info cache for port dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updated VIF entry in instance network info cache for port dfa77141-b84f-4751-9f42-f6678520df71. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2448f546-9cce-43b6-bc7e-faf98d763b58 req-4d8e13c5-8015-494a-abd9-c68070e5c26f service nova] Releasing lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG nova.network.neutron [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Successfully updated port: e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquired lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG nova.network.neutron [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-changed-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Refreshing instance network info cache due to event network-changed-e6621ff4-2e1e-4c89-877e-a05152ee45aa. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] Acquiring lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG nova.network.neutron [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:44 user nova-compute[72520]: INFO nova.compute.manager [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Terminating instance
Aug 02 23:34:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-e91795ee-6ad2-40fa-b9d3-5102027a02a6 req-26e2aca8-2848-4aea-8110-09e16faff099 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e91795ee-6ad2-40fa-b9d3-5102027a02a6 req-26e2aca8-2848-4aea-8110-09e16faff099 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e91795ee-6ad2-40fa-b9d3-5102027a02a6 req-26e2aca8-2848-4aea-8110-09e16faff099 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e91795ee-6ad2-40fa-b9d3-5102027a02a6 req-26e2aca8-2848-4aea-8110-09e16faff099 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-e91795ee-6ad2-40fa-b9d3-5102027a02a6 req-26e2aca8-2848-4aea-8110-09e16faff099 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-unplugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-e91795ee-6ad2-40fa-b9d3-5102027a02a6 req-26e2aca8-2848-4aea-8110-09e16faff099 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-c0850f91-2a68-4774-af40-1259366f9e60 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.network.neutron [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating instance_info_cache with network_info: [{"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Releasing lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Instance network_info: |[{"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] Acquired lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.network.neutron [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Refreshing network info cache for port e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Start _get_guest_xml network_info=[{"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:45 user nova-compute[72520]: WARNING nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with vm_state building and task_state spawning.
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:45 user nova-compute[72520]: WARNING nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with vm_state building and task_state spawning.
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-unplugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-654ee75f-aafc-41ad-86e4-93283a2a4022 req-a8e6be2c-40c6-4d55-9f9c-d3c8a791fbde service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-16a63599-268a-4034-a37b-5d99d65a2656 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:45 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1978334357',display_name='tempest-SnapshotDataIntegrityTests-server-1978334357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1978334357',id=14,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH1zkACakvTIP3tN43qW5QqT2qoPSXKg/mLELsBTboXah2LWD4863hs8AJashcOYPaaohGSQElF61aKdwwddSJI4skDSRuWF6VoDv1rD1zgNyfjey5+W0YMS7ctgUvgFQ==',key_name='tempest-keypair-1601786538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d0eccad94f3476680dbb44bc77656e4',ramdisk_id='',reservation_id='r-7tsmr0vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1070468552',owner_user_name='tempest-SnapshotDataIntegrityTests-1070468552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f0fc0765614221bc3599360bff975e',uuid=f0f48878-9b8a-4078-8e7b-763b1331d037,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Converting VIF {"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e6621ff4-2e1e-4c89-877e-a05152ee45aa,network=Network(2b3eba0b-7ef4-4722-9605-7e45d257a28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6621ff4-2e') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.objects.instance [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'pci_devices' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:34:45 user nova-compute[72520]:   <uuid>f0f48878-9b8a-4078-8e7b-763b1331d037</uuid>
Aug 02 23:34:45 user nova-compute[72520]:   <name>instance-0000000e</name>
Aug 02 23:34:45 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:34:45 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:34:45 user nova-compute[72520]:   <metadata>
Aug 02 23:34:45 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:34:45 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:34:45 user nova-compute[72520]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1978334357</nova:name>
Aug 02 23:34:45 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:34:45</nova:creationTime>
Aug 02 23:34:45 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:34:45 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:34:45 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:34:45 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:34:45 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:34:45 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:34:45 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:34:45 user nova-compute[72520]:       <nova:owner>
Aug 02 23:34:45 user nova-compute[72520]:         <nova:user uuid="16f0fc0765614221bc3599360bff975e">tempest-SnapshotDataIntegrityTests-1070468552-project-member</nova:user>
Aug 02 23:34:45 user nova-compute[72520]:         <nova:project uuid="3d0eccad94f3476680dbb44bc77656e4">tempest-SnapshotDataIntegrityTests-1070468552</nova:project>
Aug 02 23:34:45 user nova-compute[72520]:       </nova:owner>
Aug 02 23:34:45 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:34:45 user nova-compute[72520]:       <nova:ports>
Aug 02 23:34:45 user nova-compute[72520]:         <nova:port uuid="e6621ff4-2e1e-4c89-877e-a05152ee45aa">
Aug 02 23:34:45 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 02 23:34:45 user nova-compute[72520]:         </nova:port>
Aug 02 23:34:45 user nova-compute[72520]:       </nova:ports>
Aug 02 23:34:45 user nova-compute[72520]:     </nova:instance>
Aug 02 23:34:45 user nova-compute[72520]:   </metadata>
Aug 02 23:34:45 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:34:45 user nova-compute[72520]:     <system>
Aug 02 23:34:45 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:34:45 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:34:45 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:34:45 user nova-compute[72520]:       <entry name="serial">f0f48878-9b8a-4078-8e7b-763b1331d037</entry>
Aug 02 23:34:45 user nova-compute[72520]:       <entry name="uuid">f0f48878-9b8a-4078-8e7b-763b1331d037</entry>
Aug 02 23:34:45 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:34:45 user nova-compute[72520]:     </system>
Aug 02 23:34:45 user nova-compute[72520]:   </sysinfo>
Aug 02 23:34:45 user nova-compute[72520]:   <os>
Aug 02 23:34:45 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:34:45 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:34:45 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:34:45 user nova-compute[72520]:   </os>
Aug 02 23:34:45 user nova-compute[72520]:   <features>
Aug 02 23:34:45 user nova-compute[72520]:     <acpi/>
Aug 02 23:34:45 user nova-compute[72520]:     <apic/>
Aug 02 23:34:45 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:34:45 user nova-compute[72520]:   </features>
Aug 02 23:34:45 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:34:45 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:34:45 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:34:45 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:34:45 user nova-compute[72520]:   </clock>
Aug 02 23:34:45 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:34:45 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:34:45 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:34:45 user nova-compute[72520]:   </cpu>
Aug 02 23:34:45 user nova-compute[72520]:   <devices>
Aug 02 23:34:45 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:34:45 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:34:45 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk"/>
Aug 02 23:34:45 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:34:45 user nova-compute[72520]:     </disk>
Aug 02 23:34:45 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:34:45 user nova-compute[72520]:       <mac address="fa:16:3e:98:7d:b0"/>
Aug 02 23:34:45 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:34:45 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:34:45 user nova-compute[72520]:       <target dev="tape6621ff4-2e"/>
Aug 02 23:34:45 user nova-compute[72520]:     </interface>
Aug 02 23:34:45 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:34:45 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/console.log" append="off"/>
Aug 02 23:34:45 user nova-compute[72520]:     </serial>
Aug 02 23:34:45 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:34:45 user nova-compute[72520]:     <video>
Aug 02 23:34:45 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:34:45 user nova-compute[72520]:     </video>
Aug 02 23:34:45 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:34:45 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:34:45 user nova-compute[72520]:     </rng>
Aug 02 23:34:45 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:34:45 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:34:45 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:34:45 user nova-compute[72520]:     </memballoon>
Aug 02 23:34:45 user nova-compute[72520]:   </devices>
Aug 02 23:34:45 user nova-compute[72520]: </domain>
Aug 02 23:34:45 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1978334357',display_name='tempest-SnapshotDataIntegrityTests-server-1978334357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1978334357',id=14,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH1zkACakvTIP3tN43qW5QqT2qoPSXKg/mLELsBTboXah2LWD4863hs8AJashcOYPaaohGSQElF61aKdwwddSJI4skDSRuWF6VoDv1rD1zgNyfjey5+W0YMS7ctgUvgFQ==',key_name='tempest-keypair-1601786538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d0eccad94f3476680dbb44bc77656e4',ramdisk_id='',reservation_id='r-7tsmr0vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1070468552',owner_user_name='tempest-SnapshotDataIntegrityTests-1070468552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f0fc0765614221bc3599360bff975e',uuid=f0f48878-9b8a-4078-8e7b-763b1331d037,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Converting VIF {"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e6621ff4-2e1e-4c89-877e-a05152ee45aa,network=Network(2b3eba0b-7ef4-4722-9605-7e45d257a28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6621ff4-2e') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG os_vif [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e6621ff4-2e1e-4c89-877e-a05152ee45aa,network=Network(2b3eba0b-7ef4-4722-9605-7e45d257a28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6621ff4-2e') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6621ff4-2e, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6621ff4-2e, col_values=(('external_ids', {'iface-id': 'e6621ff4-2e1e-4c89-877e-a05152ee45aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:7d:b0', 'vm-uuid': 'f0f48878-9b8a-4078-8e7b-763b1331d037'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: INFO os_vif [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e6621ff4-2e1e-4c89-877e-a05152ee45aa,network=Network(2b3eba0b-7ef4-4722-9605-7e45d257a28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6621ff4-2e')
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:34:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No VIF found with MAC fa:16:3e:98:7d:b0, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-unplugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-cddd6045-517e-4178-87e5-a9886bcb67f8 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:46 user nova-compute[72520]: WARNING nova.compute.manager [req-b1b9e270-a4fd-4438-8583-fb7c88978228 req-a3672d7e-3f5f-4bc3-86b0-685f6566f700 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-cddd6045-517e-4178-87e5-a9886bcb67f8 for instance with vm_state active and task_state deleting.
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Instance destroyed successfully.
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.objects.instance [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lazy-loading 'resources' on Instance uuid 05ac30a1-7637-4346-a2ec-aa438eeef69f {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0c:63,bridge_name='br-int',has_traffic_filtering=True,id=16a63599-268a-4034-a37b-5d99d65a2656,network=Network(bdfa7369-65a3-4b4d-9037-4cc9913d3481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a63599-26') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0c:63,bridge_name='br-int',has_traffic_filtering=True,id=16a63599-268a-4034-a37b-5d99d65a2656,network=Network(bdfa7369-65a3-4b4d-9037-4cc9913d3481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a63599-26') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16a63599-26, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: INFO os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0c:63,bridge_name='br-int',has_traffic_filtering=True,id=16a63599-268a-4034-a37b-5d99d65a2656,network=Network(bdfa7369-65a3-4b4d-9037-4cc9913d3481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a63599-26')
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:68:6e,bridge_name='br-int',has_traffic_filtering=True,id=cddd6045-517e-4178-87e5-a9886bcb67f8,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcddd6045-51') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:68:6e,bridge_name='br-int',has_traffic_filtering=True,id=cddd6045-517e-4178-87e5-a9886bcb67f8,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcddd6045-51') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcddd6045-51, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:46 user nova-compute[72520]: INFO os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:68:6e,bridge_name='br-int',has_traffic_filtering=True,id=cddd6045-517e-4178-87e5-a9886bcb67f8,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcddd6045-51')
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:99:ab,bridge_name='br-int',has_traffic_filtering=True,id=c0850f91-2a68-4774-af40-1259366f9e60,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0850f91-2a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:99:ab,bridge_name='br-int',has_traffic_filtering=True,id=c0850f91-2a68-4774-af40-1259366f9e60,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0850f91-2a') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0850f91-2a, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: INFO os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:99:ab,bridge_name='br-int',has_traffic_filtering=True,id=c0850f91-2a68-4774-af40-1259366f9e60,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0850f91-2a')
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=51982c7d-554a-4ea1-914a-ef3819378755,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51982c7d-55') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=51982c7d-554a-4ea1-914a-ef3819378755,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51982c7d-55') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51982c7d-55, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.neutron [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updated VIF entry in instance network info cache for port e6621ff4-2e1e-4c89-877e-a05152ee45aa. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.neutron [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating instance_info_cache with network_info: [{"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0868a837-1d06-4cf2-8d87-741219b8f45d req-9e2dab73-a377-45fb-b6a2-39664cce52ab service nova] Releasing lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:47 user nova-compute[72520]: WARNING nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-c0850f91-2a68-4774-af40-1259366f9e60 for instance with vm_state active and task_state deleting.
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-unplugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-51982c7d-554a-4ea1-914a-ef3819378755 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:47 user nova-compute[72520]: WARNING nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-51982c7d-554a-4ea1-914a-ef3819378755 for instance with vm_state active and task_state deleting.
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-unplugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-94bab03a-50c9-4b36-a064-46035b2f471b for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:47 user nova-compute[72520]: WARNING nova.compute.manager [req-4c614477-6849-47fd-a34e-e2a594bec612 req-c04489b9-8d63-4d12-aed9-482359179850 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-94bab03a-50c9-4b36-a064-46035b2f471b for instance with vm_state active and task_state deleting.
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: INFO os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1c:d5,bridge_name='br-int',has_traffic_filtering=True,id=51982c7d-554a-4ea1-914a-ef3819378755,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51982c7d-55')
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0b:78,bridge_name='br-int',has_traffic_filtering=True,id=399eae41-8d85-43c5-91f2-accad5efad35,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399eae41-8d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0b:78,bridge_name='br-int',has_traffic_filtering=True,id=399eae41-8d85-43c5-91f2-accad5efad35,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399eae41-8d') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap399eae41-8d, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-ca8fb04d-a99b-40c4-81f1-e037a7248696 req-ee01918f-e4e3-4121-9b83-669c20d48bff service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ca8fb04d-a99b-40c4-81f1-e037a7248696 req-ee01918f-e4e3-4121-9b83-669c20d48bff service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ca8fb04d-a99b-40c4-81f1-e037a7248696 req-ee01918f-e4e3-4121-9b83-669c20d48bff service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ca8fb04d-a99b-40c4-81f1-e037a7248696 req-ee01918f-e4e3-4121-9b83-669c20d48bff service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-ca8fb04d-a99b-40c4-81f1-e037a7248696 req-ee01918f-e4e3-4121-9b83-669c20d48bff service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:47 user nova-compute[72520]: WARNING nova.compute.manager [req-ca8fb04d-a99b-40c4-81f1-e037a7248696 req-ee01918f-e4e3-4121-9b83-669c20d48bff service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-16a63599-268a-4034-a37b-5d99d65a2656 for instance with vm_state active and task_state deleting.
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: INFO os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0b:78,bridge_name='br-int',has_traffic_filtering=True,id=399eae41-8d85-43c5-91f2-accad5efad35,network=Network(e984d482-b5f6-4863-8f60-8c45cdd16499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap399eae41-8d')
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=94bab03a-50c9-4b36-a064-46035b2f471b,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bab03a-50') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=94bab03a-50c9-4b36-a064-46035b2f471b,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bab03a-50') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019287.4359646, 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:47 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] VM Resumed (Lifecycle Event)
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94bab03a-50, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Instance spawned successfully.
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: INFO os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=94bab03a-50c9-4b36-a064-46035b2f471b,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94bab03a-50')
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-984929273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-984929273',id=7,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiuwvO96iLz9byEZfA4HqC/i0/GLglwExm+R1A6Q2hlKUJXt7UdIgIsTk+WxAOSYtZ+bvGls0C7Fy08M47ppXeoBbyFeggdx5K5FmdO+58lp4y/SBWve+7Y/R1Gniw1IA==',key_name='tempest-keypair-221635631',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4859fb53c10e4bb0a81d1bf982c0ab19',ramdisk_id='',reservation_id='r-0v1utace',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-684754732',owner_user_name='tempest-TaggedBootDevicesTest-684754732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1419fb3de83c4743b688b0b3563f92da',uuid=05ac30a1-7637-4346-a2ec-aa438eeef69f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converting VIF {"id": "a40db34b-cabb-49fe-b042-89be1390f91a", "address": "fa:16:3e:6c:e0:67", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa40db34b-ca", "ovs_interfaceid": "a40db34b-cabb-49fe-b042-89be1390f91a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e0:67,bridge_name='br-int',has_traffic_filtering=True,id=a40db34b-cabb-49fe-b042-89be1390f91a,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40db34b-ca') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e0:67,bridge_name='br-int',has_traffic_filtering=True,id=a40db34b-cabb-49fe-b042-89be1390f91a,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40db34b-ca') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa40db34b-ca, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:47 user nova-compute[72520]: INFO os_vif [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e0:67,bridge_name='br-int',has_traffic_filtering=True,id=a40db34b-cabb-49fe-b042-89be1390f91a,network=Network(2e0dce06-7f64-4ebc-b21a-7ee13be166dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa40db34b-ca')
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caXnSRdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:47 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:47 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:47 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019287.4361622, 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:47 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] VM Started (Lifecycle Event)
Aug 02 23:34:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.065s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b36d462-c300-4ed6-b260-02a4f5c5c9ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Took 11.41 seconds to spawn the instance on the hypervisor.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-unplugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-399eae41-8d85-43c5-91f2-accad5efad35 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:50 user nova-compute[72520]: WARNING nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-399eae41-8d85-43c5-91f2-accad5efad35 for instance with vm_state active and task_state deleting.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-unplugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-unplugged-a40db34b-cabb-49fe-b042-89be1390f91a for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Acquiring lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] No waiting events found dispatching network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:50 user nova-compute[72520]: WARNING nova.compute.manager [req-1b43c981-30ca-49b2-8489-1ac21452a644 req-6054664c-420e-4ece-9f69-8e86f8c35876 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received unexpected event network-vif-plugged-a40db34b-cabb-49fe-b042-89be1390f91a for instance with vm_state active and task_state deleting.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] No waiting events found dispatching network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:50 user nova-compute[72520]: WARNING nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received unexpected event network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa for instance with vm_state building and task_state spawning.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-changed-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Refreshing instance network info cache due to event network-changed-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Acquiring lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Acquired lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Refreshing network info cache for port 35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.compute.manager [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Rebuilding instance
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Instance spawned successfully.
Aug 02 23:34:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7377MB free_disk=25.750099182128906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[371c11ea-6fa2-4557-a93d-2f804410da1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:50 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d0a4b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019290.3484378, f0f48878-9b8a-4078-8e7b-763b1331d037 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] VM Resumed (Lifecycle Event)
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[205fe1aa-f759-4d2c-a10c-455f4d4bd1c6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019290.349361, f0f48878-9b8a-4078-8e7b-763b1331d037 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] VM Started (Lifecycle Event)
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c448b-1cc8-4081-b8d5-21d916e889ee]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:50 user nova-compute[72520]: INFO nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Took 8.87 seconds to spawn the instance on the hypervisor.
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2f989d-3fe2-49f7-a64d-14fae73b1a4a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:51 user nova-compute[72520]: INFO nova.compute.manager [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Took 12.41 seconds to build instance.
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8e524afb-4d71-43a5-8b91-4f558c409237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b86f31d4-33c5-4b2b-a235-3b07b306f23a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a9fa9eda-ec05-4346-8694-89c2cd021663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 231d5de3-cf80-43bd-90b8-58182eb36fdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 00e60fe9-f01d-4b28-9870-a1c6a372d716 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0123787e-4684-4f17-9605-5189590901cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a425b6aa-bb98-4b02-8263-571f8e1707c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 049ff42c-34d8-4077-b995-537d58ccc8bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45e0ae-423a-438e-ab6a-33181c24b1d4]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-613effc3-4107-437a-af5c-fc942beb26f7 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.535s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[406af309-28aa-401b-9361-2a464bb22001]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'pci_requests' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'pci_devices' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:51 user nova-compute[72520]: INFO nova.compute.manager [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Took 9.82 seconds to build instance.
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'resources' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'migration_context' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-16dd5045-c43d-416c-839c-61906194b0e5 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.930s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e4b995-9dbb-4698-8a87-16b85f8cd32e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260]
Aug 02 23:34:51 user nova-compute[72520]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4c557-ed85-433e-86ec-673dd7c2842e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.058s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4164dd53-0400-4006-aac3-cc33c08f128e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 3.703s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== disconnect_volume: return (3703ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiXhDPzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:51 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe7ffb-ac19-4126-8117-c0fcf3c8019e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec9896a-193d-4c95-ab51-985b7e89865d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc2c1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20'): ({'sde'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Removing single pathed devices sde {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da23b652-2713-4451-8887-4abe128dfad7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd733f00-3d81-4709-a8ee-4705a4058acc]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Flushing IO for device /dev/sde {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa2d801-d9d3-4706-a4c1-ebae33c5b1d5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updated VIF entry in instance network info cache for port 35d45074-4fe3-44a2-a7f7-9f6c4057ae4e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updating instance_info_cache with network_info: [{"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Releasing lock "refresh_cache-00e60fe9-f01d-4b28-9870-a1c6a372d716" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] No waiting events found dispatching network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:51 user nova-compute[72520]: WARNING nova.compute.manager [req-2a59045e-7706-489b-8a33-fac678001513 req-0ba0ea99-91b4-4b9a-a0b7-9c084d9bd39c service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received unexpected event network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa for instance with vm_state building and task_state spawning.
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4126b86-b585-41c3-96e3-cf6104c04edd]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] SCSI volumes sde have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-47460dd6-a74f-4c87-b0a4-6a6e04d3b3fb req-85862a09-ec22-4c76-aca7-94ae493b911d service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-unplugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-47460dd6-a74f-4c87-b0a4-6a6e04d3b3fb req-85862a09-ec22-4c76-aca7-94ae493b911d service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-47460dd6-a74f-4c87-b0a4-6a6e04d3b3fb req-85862a09-ec22-4c76-aca7-94ae493b911d service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-47460dd6-a74f-4c87-b0a4-6a6e04d3b3fb req-85862a09-ec22-4c76-aca7-94ae493b911d service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-47460dd6-a74f-4c87-b0a4-6a6e04d3b3fb req-85862a09-ec22-4c76-aca7-94ae493b911d service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-unplugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:51 user nova-compute[72520]: WARNING nova.compute.manager [req-47460dd6-a74f-4c87-b0a4-6a6e04d3b3fb req-85862a09-ec22-4c76-aca7-94ae493b911d service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received unexpected event network-vif-unplugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with vm_state active and task_state rebuilding.
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692d707-060c-4402-a6e9-98821190ab75]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e391d626-fd64-4538-804a-7b855f0a1ca3]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260]
Aug 02 23:34:51 user nova-compute[72520]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.800s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:887f14cb-4bd3-41d9-891f-e9cee8291b20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b1e7f3-2947-43bb-8d22-182a605bad29]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== disconnect_volume: return (391ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRFtQScH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:51 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[de304d05-1d0a-4d4f-b829-6ea06ecb5441]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28fffc7-96fd-44f3-bceb-b12ec68ac8c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 (non-flash)
Aug 02 23:34:51 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d0a4e2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3'): ({'sdg'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Removing single pathed devices sdg {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e10296b-a83c-428e-afef-1390bf87749a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceedef1b-09dc-43a6-ba39-d05715425b29]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Flushing IO for device /dev/sdg {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9437582b-8bf7-475d-844e-6971dd2cf7ea]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062150c-1762-4671-9ad2-c85dc7386eb6]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] SCSI volumes sdg have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d79223-725f-4172-b701-db29296be404]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance destroyed successfully.
Aug 02 23:34:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance destroyed successfully.
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1247750399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1542430789',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqvLzVCkT8bvzftZb7AMDtHeOMmBeFF4frxcylAlJx/jSrTkfK6q1ipNE5vvyJL659Jqn7d5hR74At3igrlIj99nJf8DtlmKuHNmRx79SKYiGCP4W7B16NyaDt7cZEv5Q==',key_name='tempest-keypair-57639330',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-y0imkgwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=00e60fe9-f01d-4b28-9870-a1c6a372d716,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_vif [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d45074-4f, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a814947-83da-4932-8b44-661db4f6e43d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260]
Aug 02 23:34:52 user nova-compute[72520]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:34:52 user nova-compute[72520]: INFO os_vif [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f')
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:52 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:463e56cd-f9db-4e53-bcb6-5a3f57fd6fc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea638d7-fdfe-4694-8d94-e6d9d64b69f3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] <== disconnect_volume: return (389ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Deleting instance files /opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f_del
Aug 02 23:34:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Deletion of /opt/stack/data/nova/instances/05ac30a1-7637-4346-a2ec-aa438eeef69f_del complete
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.031s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc92966-db92-4229-9e34-29f9f46ae834]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[058eceab-c6e5-4f35-ba4e-0a71050b16ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:52 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:52 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:34:52 user nova-compute[72520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:52 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc1228c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'): ({'sdi'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Removing single pathed devices sdi {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: INFO nova.compute.manager [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Took 7.67 seconds to destroy the instance on the hypervisor.
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f4520e-19d2-40ab-9090-be04eaa37f15]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b51e928-275b-428c-8c4c-3af972f2aff3]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flushing IO for device /dev/sdi {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876ad0c-71b6-4cac-9599-5ce075237c68]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.082s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3c050a-676f-493a-85a7-f31622da0621]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] SCSI volumes sdi have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_72683aee', '/dev/disk/by-id/scsi-1SCST_BIO72683aee-23dd79d987259cde', '/dev/disk/by-id/scsi-23233646437396439') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 02 23:34:52 user nova-compute[72520]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_72683aee
Aug 02 23:34:52 user nova-compute[72520]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO72683aee-23dd79d987259cde
Aug 02 23:34:52 user nova-compute[72520]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23233646437396439
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0b0dd7-6f9b-40cc-963f-4b363eb6ebc3]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4266c57-5088-468d-b6ac-4d1cb2f887bb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5557e31-a69d-4c53-afb6-049889a77010]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]
Aug 02 23:34:52 user nova-compute[72520]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.
Aug 02 23:34:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e926af2-ca9a-4590-a9b8-2c883b001ab8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] <== disconnect_volume: return (444ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Deleting instance files /opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716_del
Aug 02 23:34:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Deletion of /opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716_del complete
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:34:52 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 00e60fe9-f01d-4b28-9870-a1c6a372d716 could not be found.
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:34:52 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f02e3-5cb2-4305-8cd2-1342a2110a43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30c8677-81d5-4af8-b80e-d3d8c4c4516e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:52 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:34:52 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:34:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4408b80>, {}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Disconnecting from: [] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] <== disconnect_volume: return (64ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:34:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-651636b5-b0db-480a-af26-a288d73807c4 req-a8a45c1a-ab65-42c9-af37-fff18eade3b1 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-651636b5-b0db-480a-af26-a288d73807c4 req-a8a45c1a-ab65-42c9-af37-fff18eade3b1 service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-651636b5-b0db-480a-af26-a288d73807c4 req-a8a45c1a-ab65-42c9-af37-fff18eade3b1 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-651636b5-b0db-480a-af26-a288d73807c4 req-a8a45c1a-ab65-42c9-af37-fff18eade3b1 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-651636b5-b0db-480a-af26-a288d73807c4 req-a8a45c1a-ab65-42c9-af37-fff18eade3b1 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:34:53 user nova-compute[72520]: WARNING nova.compute.manager [req-651636b5-b0db-480a-af26-a288d73807c4 req-a8a45c1a-ab65-42c9-af37-fff18eade3b1 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received unexpected event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with vm_state active and task_state rebuilding.
Aug 02 23:34:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Preparing to wait for external event volume-reimaged-9b19b835-a22d-474e-9aa6-a003b53c151f {{(pid=72520) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:34:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:34:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-4f0ba31b-eb3c-4178-b6b8-c1a7f38f88af req-d39953da-8dc9-4b10-9ffd-0cbc66fc49aa service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-deleted-a40db34b-cabb-49fe-b042-89be1390f91a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:55 user nova-compute[72520]: INFO nova.compute.manager [req-4f0ba31b-eb3c-4178-b6b8-c1a7f38f88af req-d39953da-8dc9-4b10-9ffd-0cbc66fc49aa service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Neutron deleted interface a40db34b-cabb-49fe-b042-89be1390f91a; detaching it from the instance and deleting it from the info cache
Aug 02 23:34:55 user nova-compute[72520]: DEBUG nova.network.neutron [req-4f0ba31b-eb3c-4178-b6b8-c1a7f38f88af req-d39953da-8dc9-4b10-9ffd-0cbc66fc49aa service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51982c7d-554a-4ea1-914a-ef3819378755", "address": "fa:16:3e:3d:1c:d5", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51982c7d-55", "ovs_interfaceid": "51982c7d-554a-4ea1-914a-ef3819378755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-4f0ba31b-eb3c-4178-b6b8-c1a7f38f88af req-d39953da-8dc9-4b10-9ffd-0cbc66fc49aa service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Detach interface failed, port_id=a40db34b-cabb-49fe-b042-89be1390f91a, reason: Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:34:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-deleted-51982c7d-554a-4ea1-914a-ef3819378755 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:57 user nova-compute[72520]: INFO nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Neutron deleted interface 51982c7d-554a-4ea1-914a-ef3819378755; detaching it from the instance and deleting it from the info cache
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94bab03a-50c9-4b36-a064-46035b2f471b", "address": "fa:16:3e:2c:52:8a", "network": {"id": "2e0dce06-7f64-4ebc-b21a-7ee13be166dc", "bridge": "br-int", "label": "tempest-device-tagging-net2-260368508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94bab03a-50", "ovs_interfaceid": "94bab03a-50c9-4b36-a064-46035b2f471b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Detach interface failed, port_id=51982c7d-554a-4ea1-914a-ef3819378755, reason: Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-deleted-94bab03a-50c9-4b36-a064-46035b2f471b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:57 user nova-compute[72520]: INFO nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Neutron deleted interface 94bab03a-50c9-4b36-a064-46035b2f471b; detaching it from the instance and deleting it from the info cache
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "16a63599-268a-4034-a37b-5d99d65a2656", "address": "fa:16:3e:3f:0c:63", "network": {"id": "bdfa7369-65a3-4b4d-9037-4cc9913d3481", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-788010967-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a63599-26", "ovs_interfaceid": "16a63599-268a-4034-a37b-5d99d65a2656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Detach interface failed, port_id=94bab03a-50c9-4b36-a064-46035b2f471b, reason: Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-deleted-16a63599-268a-4034-a37b-5d99d65a2656 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:57 user nova-compute[72520]: INFO nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Neutron deleted interface 16a63599-268a-4034-a37b-5d99d65a2656; detaching it from the instance and deleting it from the info cache
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "399eae41-8d85-43c5-91f2-accad5efad35", "address": "fa:16:3e:d4:0b:78", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap399eae41-8d", "ovs_interfaceid": "399eae41-8d85-43c5-91f2-accad5efad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:57 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Took 5.37 seconds to deallocate network for instance.
Aug 02 23:34:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-f383573e-0e05-42a0-8be3-8f1c9237a07c req-7a8eca19-ea85-4782-a009-16d1f67bb996 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Detach interface failed, port_id=16a63599-268a-4034-a37b-5d99d65a2656, reason: Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:34:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:34:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-e614f7c0-601c-44e4-aab6-fc8486e14fd1 req-70de795c-fdd6-4f16-b17c-06869aeb9669 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Received event network-vif-deleted-399eae41-8d85-43c5-91f2-accad5efad35 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:34:59 user nova-compute[72520]: INFO nova.compute.manager [req-e614f7c0-601c-44e4-aab6-fc8486e14fd1 req-70de795c-fdd6-4f16-b17c-06869aeb9669 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Neutron deleted interface 399eae41-8d85-43c5-91f2-accad5efad35; detaching it from the instance and deleting it from the info cache
Aug 02 23:34:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-e614f7c0-601c-44e4-aab6-fc8486e14fd1 req-70de795c-fdd6-4f16-b17c-06869aeb9669 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Updating instance_info_cache with network_info: [{"id": "cddd6045-517e-4178-87e5-a9886bcb67f8", "address": "fa:16:3e:d1:68:6e", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcddd6045-51", "ovs_interfaceid": "cddd6045-517e-4178-87e5-a9886bcb67f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0850f91-2a68-4774-af40-1259366f9e60", "address": "fa:16:3e:c9:99:ab", "network": {"id": "e984d482-b5f6-4863-8f60-8c45cdd16499", "bridge": "br-int", "label": "tempest-device-tagging-net1-153947575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4859fb53c10e4bb0a81d1bf982c0ab19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0850f91-2a", "ovs_interfaceid": "c0850f91-2a68-4774-af40-1259366f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:34:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-e614f7c0-601c-44e4-aab6-fc8486e14fd1 req-70de795c-fdd6-4f16-b17c-06869aeb9669 service nova] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Detach interface failed, port_id=399eae41-8d85-43c5-91f2-accad5efad35, reason: Instance 05ac30a1-7637-4346-a2ec-aa438eeef69f could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:34:59 user nova-compute[72520]: INFO nova.compute.manager [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Took 2.39 seconds to detach 3 volumes for instance.
Aug 02 23:34:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:34:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:00 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:35:00 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:35:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:00 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Deleted allocations for instance 05ac30a1-7637-4346-a2ec-aa438eeef69f
Aug 02 23:35:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-795836d3-184b-4cb9-a47a-0f6f62e1dd93 tempest-TaggedBootDevicesTest-684754732 tempest-TaggedBootDevicesTest-684754732-project-member] Lock "05ac30a1-7637-4346-a2ec-aa438eeef69f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.175s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:01 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019286.523965, 05ac30a1-7637-4346-a2ec-aa438eeef69f => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:35:01 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] VM Stopped (Lifecycle Event)
Aug 02 23:35:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-aa44e3e4-7058-4b5d-bc9f-7a6c38eeb141 None None] [instance: 05ac30a1-7637-4346-a2ec-aa438eeef69f] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-changed-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Refreshing instance network info cache due to event network-changed-69147d0e-fd7d-47df-b872-750ead41f42a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:35:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] Acquiring lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:35:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] Acquired lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:35:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Refreshing network info cache for port 69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "0123787e-4684-4f17-9605-5189590901cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "0123787e-4684-4f17-9605-5189590901cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "0123787e-4684-4f17-9605-5189590901cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "0123787e-4684-4f17-9605-5189590901cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "0123787e-4684-4f17-9605-5189590901cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:06 user nova-compute[72520]: INFO nova.compute.manager [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Terminating instance
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:06 user nova-compute[72520]: INFO nova.compute.manager [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Terminating instance
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Updated VIF entry in instance network info cache for port 69147d0e-fd7d-47df-b872-750ead41f42a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Updating instance_info_cache with network_info: [{"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7737e072-cf2e-47ea-984c-dd39eb5b3048 req-441b0551-c983-4a2b-9220-281e179e7df1 service nova] Releasing lock "refresh_cache-0123787e-4684-4f17-9605-5189590901cf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-1144e1cf-76f8-4358-b947-e443fd5a48aa req-f986e2ef-a4e3-44e8-a022-870afdb696c7 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-vif-unplugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1144e1cf-76f8-4358-b947-e443fd5a48aa req-f986e2ef-a4e3-44e8-a022-870afdb696c7 service nova] Acquiring lock "0123787e-4684-4f17-9605-5189590901cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1144e1cf-76f8-4358-b947-e443fd5a48aa req-f986e2ef-a4e3-44e8-a022-870afdb696c7 service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1144e1cf-76f8-4358-b947-e443fd5a48aa req-f986e2ef-a4e3-44e8-a022-870afdb696c7 service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-1144e1cf-76f8-4358-b947-e443fd5a48aa req-f986e2ef-a4e3-44e8-a022-870afdb696c7 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] No waiting events found dispatching network-vif-unplugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-1144e1cf-76f8-4358-b947-e443fd5a48aa req-f986e2ef-a4e3-44e8-a022-870afdb696c7 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-vif-unplugged-69147d0e-fd7d-47df-b872-750ead41f42a for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:35:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0123787e-4684-4f17-9605-5189590901cf] Instance destroyed successfully.
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'resources' on Instance uuid 0123787e-4684-4f17-9605-5189590901cf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-420932723',display_name='tempest-AttachVolumeNegativeTest-server-420932723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-420932723',id=10,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvVr8DSEo/giZW5x7n492KEKcFF9zE74GQTh11LuaTqrO/KrgVAsEbiBRJB+DBMXH2MYfydmqU8koivUODdAh6dgAews15UhOJaO6kwFOzl6G6pT1YNN7zH76+ORdWXug==',key_name='tempest-keypair-84727315',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-8ac9p0l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:33:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=0123787e-4684-4f17-9605-5189590901cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "69147d0e-fd7d-47df-b872-750ead41f42a", "address": "fa:16:3e:b9:70:57", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69147d0e-fd", "ovs_interfaceid": "69147d0e-fd7d-47df-b872-750ead41f42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:57,bridge_name='br-int',has_traffic_filtering=True,id=69147d0e-fd7d-47df-b872-750ead41f42a,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69147d0e-fd') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG os_vif [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:57,bridge_name='br-int',has_traffic_filtering=True,id=69147d0e-fd7d-47df-b872-750ead41f42a,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69147d0e-fd') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69147d0e-fd, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:06 user nova-compute[72520]: INFO os_vif [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:57,bridge_name='br-int',has_traffic_filtering=True,id=69147d0e-fd7d-47df-b872-750ead41f42a,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69147d0e-fd')
Aug 02 23:35:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Deleting instance files /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf_del
Aug 02 23:35:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Deletion of /opt/stack/data/nova/instances/0123787e-4684-4f17-9605-5189590901cf_del complete
Aug 02 23:35:06 user nova-compute[72520]: INFO nova.compute.manager [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 0123787e-4684-4f17-9605-5189590901cf] Took 0.79 seconds to destroy the instance on the hypervisor.
Aug 02 23:35:06 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 0123787e-4684-4f17-9605-5189590901cf] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0123787e-4684-4f17-9605-5189590901cf] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:35:06 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019291.981277, 00e60fe9-f01d-4b28-9870-a1c6a372d716 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:35:06 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] VM Stopped (Lifecycle Event)
Aug 02 23:35:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-a7d9f255-5e30-42a8-8808-988e4d1d968c None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Instance destroyed successfully.
Aug 02 23:35:07 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lazy-loading 'resources' on Instance uuid 231d5de3-cf80-43bd-90b8-58182eb36fdd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1149143244',display_name='tempest-TestVolumeSwap-server-1149143244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1149143244',id=6,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrR/68gjpVtSLkCkHP17+vxRoprqZ8exlkFQlBTEwn9DBGXID9ZxNNfxWw0J8KEzUMVAFTPUKXLdtjnKXlSqlE6qPXyxe7fJWIMw6fpQfiHKulojBtjWIXd/DRX3k84gA==',key_name='tempest-keypair-30034236',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='056c4e1e57dd46ddb0d8266dd97afac0',ramdisk_id='',reservation_id='r-uts09me5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-509973836',owner_user_name='tempest-TestVolumeSwap-509973836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54b2dcc75514f84a7122b50e2a8800b',uuid=231d5de3-cf80-43bd-90b8-58182eb36fdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Converting VIF {"id": "895193a1-de0e-418c-871f-eab8db933ed4", "address": "fa:16:3e:1b:2e:5a", "network": {"id": "913a902d-bc53-4a48-9fdc-5e3aeb721b9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1870400037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "056c4e1e57dd46ddb0d8266dd97afac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap895193a1-de", "ovs_interfaceid": "895193a1-de0e-418c-871f-eab8db933ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2e:5a,bridge_name='br-int',has_traffic_filtering=True,id=895193a1-de0e-418c-871f-eab8db933ed4,network=Network(913a902d-bc53-4a48-9fdc-5e3aeb721b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895193a1-de') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG os_vif [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2e:5a,bridge_name='br-int',has_traffic_filtering=True,id=895193a1-de0e-418c-871f-eab8db933ed4,network=Network(913a902d-bc53-4a48-9fdc-5e3aeb721b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895193a1-de') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap895193a1-de, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:35:07 user nova-compute[72520]: INFO os_vif [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:2e:5a,bridge_name='br-int',has_traffic_filtering=True,id=895193a1-de0e-418c-871f-eab8db933ed4,network=Network(913a902d-bc53-4a48-9fdc-5e3aeb721b9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap895193a1-de')
Aug 02 23:35:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Deleting instance files /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd_del
Aug 02 23:35:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Deletion of /opt/stack/data/nova/instances/231d5de3-cf80-43bd-90b8-58182eb36fdd_del complete
Aug 02 23:35:07 user nova-compute[72520]: INFO nova.compute.manager [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 02 23:35:07 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:35:07 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0123787e-4684-4f17-9605-5189590901cf] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:35:08 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0123787e-4684-4f17-9605-5189590901cf] Took 1.53 seconds to deallocate network for instance.
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:35:08 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Took 1.38 seconds to deallocate network for instance.
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-73da2bc9-6180-4dfb-8f1f-60671f99b686 req-fbd86c27-af8a-47af-8395-8c1182076da6 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received event network-vif-deleted-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Acquiring lock "0123787e-4684-4f17-9605-5189590901cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Lock "0123787e-4684-4f17-9605-5189590901cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] No waiting events found dispatching network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:08 user nova-compute[72520]: WARNING nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received unexpected event network-vif-plugged-69147d0e-fd7d-47df-b872-750ead41f42a for instance with vm_state deleted and task_state None.
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received event network-vif-unplugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] No waiting events found dispatching network-vif-unplugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:08 user nova-compute[72520]: WARNING nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received unexpected event network-vif-unplugged-895193a1-de0e-418c-871f-eab8db933ed4 for instance with vm_state deleted and task_state None.
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received event network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Acquiring lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] No waiting events found dispatching network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:08 user nova-compute[72520]: WARNING nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Received unexpected event network-vif-plugged-895193a1-de0e-418c-871f-eab8db933ed4 for instance with vm_state deleted and task_state None.
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-071eba77-8571-4918-954c-ef5ea41466f2 req-44c1f215-1133-4617-a84c-1a9c8fd14a72 service nova] [instance: 0123787e-4684-4f17-9605-5189590901cf] Received event network-vif-deleted-69147d0e-fd7d-47df-b872-750ead41f42a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:08 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:35:09 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:35:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.328s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:09 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Deleted allocations for instance 0123787e-4684-4f17-9605-5189590901cf
Aug 02 23:35:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dfa45011-65e2-40f4-b43c-f7c362d493fa tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "0123787e-4684-4f17-9605-5189590901cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.071s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:09 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:35:09 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:35:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:09 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Deleted allocations for instance 231d5de3-cf80-43bd-90b8-58182eb36fdd
Aug 02 23:35:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2206f99d-8f3b-4d79-baf1-b8c79c04d04d tempest-TestVolumeSwap-509973836 tempest-TestVolumeSwap-509973836-project-member] Lock "231d5de3-cf80-43bd-90b8-58182eb36fdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.206s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da req-88d74929-0b5b-436e-b5ad-d819fa74575f service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event volume-reimaged-9b19b835-a22d-474e-9aa6-a003b53c151f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da req-88d74929-0b5b-436e-b5ad-d819fa74575f service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da req-88d74929-0b5b-436e-b5ad-d819fa74575f service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da req-88d74929-0b5b-436e-b5ad-d819fa74575f service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da req-88d74929-0b5b-436e-b5ad-d819fa74575f service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Processing event volume-reimaged-9b19b835-a22d-474e-9aa6-a003b53c151f {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:35:11 user nova-compute[72520]: INFO nova.virt.block_device [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Booting with volume 9b19b835-a22d-474e-9aa6-a003b53c151f at /dev/vda
Aug 02 23:35:11 user nova-compute[72520]: DEBUG os_brick.utils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f00a62-daed-43cc-a89a-e7a3aa0ff41e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[18230726-bc79-49fa-8704-515573d3fbbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a21565-319a-42a1-a0bf-9738a26a1992]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0100fe7-2e22-4bc8-b1ea-69cc690e376d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:35:11 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:35:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad349c4-fd86-44e0-942b-f85d971aaa84]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG os_brick.utils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:35:11 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updating existing volume attachment record: aa69f355-1522-452d-83c1-d6cd0edd554d {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:35:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:35:19 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Creating image(s)
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Ensure instance console log exists: /opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Start _get_guest_xml network_info=[{"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00e60fe9-f01d-4b28-9870-a1c6a372d716', 'attached_at': '', 'detached_at': '', 'volume_id': '9b19b835-a22d-474e-9aa6-a003b53c151f', 'serial': '9b19b835-a22d-474e-9aa6-a003b53c151f'}, 'attachment_id': 'aa69f355-1522-452d-83c1-d6cd0edd554d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:35:19 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 02 23:35:19 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:35:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:35:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:35:19 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6cb2c8-c80b-4d1c-a113-6f55e9b963fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:35:19 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[526814bb-e663-4011-a07d-2c87dc1b7235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f] added
Aug 02 23:35:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2879ad5e-9879-4e21-989c-98c29a004b82]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393cbff-c879-41e5-bb22-8cfe8ca53ffb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqwaCmAF {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqwaCmAF" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08db7c6-6028-42b4-93d8-6bad7b80d38c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OqwaCmAF'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2079c4ae-44e7-418d-9bfb-763f034164f0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea7fb5-7bca-4a90-af55-d0c66b61224e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:35:19 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:35:19 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:35:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa94f389-104e-4b57-b92e-2fda551d9c4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]
Aug 02 23:35:20 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.
Aug 02 23:35:20 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79bc35a-61dd-4089-aa82-86350b1bb7f8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0491485d-9a58-4f41-896f-afab0059944e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:35:20 user nova-compute[72520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:35:20 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:20 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:35:20 user nova-compute[72520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:35:20 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:20 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[92486db6-7be8-48d4-a96b-579486efe36e]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:35:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23233646437396439', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233646437396439', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1247750399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1542430789',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqvLzVCkT8bvzftZb7AMDtHeOMmBeFF4frxcylAlJx/jSrTkfK6q1ipNE5vvyJL659Jqn7d5hR74At3igrlIj99nJf8DtlmKuHNmRx79SKYiGCP4W7B16NyaDt7cZEv5Q==',key_name='tempest-keypair-57639330',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-y0imkgwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:35:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=00e60fe9-f01d-4b28-9870-a1c6a372d716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:35:21 user nova-compute[72520]:   <uuid>00e60fe9-f01d-4b28-9870-a1c6a372d716</uuid>
Aug 02 23:35:21 user nova-compute[72520]:   <name>instance-00000009</name>
Aug 02 23:35:21 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:35:21 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:35:21 user nova-compute[72520]:   <metadata>
Aug 02 23:35:21 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:35:21 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:35:21 user nova-compute[72520]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1247750399</nova:name>
Aug 02 23:35:21 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:35:19</nova:creationTime>
Aug 02 23:35:21 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:35:21 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:35:21 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:35:21 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:35:21 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:35:21 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:35:21 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:35:21 user nova-compute[72520]:       <nova:owner>
Aug 02 23:35:21 user nova-compute[72520]:         <nova:user uuid="5c16da763da24854b7921b9e9d6fe59e">tempest-ServerActionsV293TestJSON-1063891997-project-member</nova:user>
Aug 02 23:35:21 user nova-compute[72520]:         <nova:project uuid="75a3862c26eb4331b72c545cf91e3802">tempest-ServerActionsV293TestJSON-1063891997</nova:project>
Aug 02 23:35:21 user nova-compute[72520]:       </nova:owner>
Aug 02 23:35:21 user nova-compute[72520]:       <nova:ports>
Aug 02 23:35:21 user nova-compute[72520]:         <nova:port uuid="35d45074-4fe3-44a2-a7f7-9f6c4057ae4e">
Aug 02 23:35:21 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 02 23:35:21 user nova-compute[72520]:         </nova:port>
Aug 02 23:35:21 user nova-compute[72520]:       </nova:ports>
Aug 02 23:35:21 user nova-compute[72520]:     </nova:instance>
Aug 02 23:35:21 user nova-compute[72520]:   </metadata>
Aug 02 23:35:21 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:35:21 user nova-compute[72520]:     <system>
Aug 02 23:35:21 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:35:21 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:35:21 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:35:21 user nova-compute[72520]:       <entry name="serial">00e60fe9-f01d-4b28-9870-a1c6a372d716</entry>
Aug 02 23:35:21 user nova-compute[72520]:       <entry name="uuid">00e60fe9-f01d-4b28-9870-a1c6a372d716</entry>
Aug 02 23:35:21 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:35:21 user nova-compute[72520]:     </system>
Aug 02 23:35:21 user nova-compute[72520]:   </sysinfo>
Aug 02 23:35:21 user nova-compute[72520]:   <os>
Aug 02 23:35:21 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:35:21 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:35:21 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:35:21 user nova-compute[72520]:   </os>
Aug 02 23:35:21 user nova-compute[72520]:   <features>
Aug 02 23:35:21 user nova-compute[72520]:     <acpi/>
Aug 02 23:35:21 user nova-compute[72520]:     <apic/>
Aug 02 23:35:21 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:35:21 user nova-compute[72520]:   </features>
Aug 02 23:35:21 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:35:21 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:35:21 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:35:21 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:35:21 user nova-compute[72520]:   </clock>
Aug 02 23:35:21 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:35:21 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:35:21 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:35:21 user nova-compute[72520]:   </cpu>
Aug 02 23:35:21 user nova-compute[72520]:   <devices>
Aug 02 23:35:21 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:35:21 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:35:21 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 02 23:35:21 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:35:21 user nova-compute[72520]:       <serial>9b19b835-a22d-474e-9aa6-a003b53c151f</serial>
Aug 02 23:35:21 user nova-compute[72520]:     </disk>
Aug 02 23:35:21 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:35:21 user nova-compute[72520]:       <mac address="fa:16:3e:c1:eb:0f"/>
Aug 02 23:35:21 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:35:21 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:35:21 user nova-compute[72520]:       <target dev="tap35d45074-4f"/>
Aug 02 23:35:21 user nova-compute[72520]:     </interface>
Aug 02 23:35:21 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:35:21 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716/console.log" append="off"/>
Aug 02 23:35:21 user nova-compute[72520]:     </serial>
Aug 02 23:35:21 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:35:21 user nova-compute[72520]:     <video>
Aug 02 23:35:21 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:35:21 user nova-compute[72520]:     </video>
Aug 02 23:35:21 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:35:21 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:35:21 user nova-compute[72520]:     </rng>
Aug 02 23:35:21 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:35:21 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:35:21 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:35:21 user nova-compute[72520]:     </memballoon>
Aug 02 23:35:21 user nova-compute[72520]:   </devices>
Aug 02 23:35:21 user nova-compute[72520]: </domain>
Aug 02 23:35:21 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1247750399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1542430789',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqvLzVCkT8bvzftZb7AMDtHeOMmBeFF4frxcylAlJx/jSrTkfK6q1ipNE5vvyJL659Jqn7d5hR74At3igrlIj99nJf8DtlmKuHNmRx79SKYiGCP4W7B16NyaDt7cZEv5Q==',key_name='tempest-keypair-57639330',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-y0imkgwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:35:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=00e60fe9-f01d-4b28-9870-a1c6a372d716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG os_vif [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d45074-4f, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35d45074-4f, col_values=(('external_ids', {'iface-id': '35d45074-4fe3-44a2-a7f7-9f6c4057ae4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:eb:0f', 'vm-uuid': '00e60fe9-f01d-4b28-9870-a1c6a372d716'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:21 user nova-compute[72520]: INFO os_vif [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f')
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] No VIF found with MAC fa:16:3e:c1:eb:0f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019306.8148685, 0123787e-4684-4f17-9605-5189590901cf => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:35:21 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0123787e-4684-4f17-9605-5189590901cf] VM Stopped (Lifecycle Event)
Aug 02 23:35:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f155e933-e486-4bb7-92e5-da75cf710963 None None] [instance: 0123787e-4684-4f17-9605-5189590901cf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019307.1633928, 231d5de3-cf80-43bd-90b8-58182eb36fdd => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:35:22 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] VM Stopped (Lifecycle Event)
Aug 02 23:35:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f8b00d5a-4797-4bb3-b85e-54ba5264bc06 None None] [instance: 231d5de3-cf80-43bd-90b8-58182eb36fdd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-9db12e13-f319-4801-a193-ad2acec07249 req-9499d636-1b79-475d-885a-b2fd6c45c37f service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9db12e13-f319-4801-a193-ad2acec07249 req-9499d636-1b79-475d-885a-b2fd6c45c37f service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9db12e13-f319-4801-a193-ad2acec07249 req-9499d636-1b79-475d-885a-b2fd6c45c37f service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9db12e13-f319-4801-a193-ad2acec07249 req-9499d636-1b79-475d-885a-b2fd6c45c37f service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-9db12e13-f319-4801-a193-ad2acec07249 req-9499d636-1b79-475d-885a-b2fd6c45c37f service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:22 user nova-compute[72520]: WARNING nova.compute.manager [req-9db12e13-f319-4801-a193-ad2acec07249 req-9499d636-1b79-475d-885a-b2fd6c45c37f service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received unexpected event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with vm_state active and task_state rebuild_spawning.
Aug 02 23:35:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019324.6589031, 00e60fe9-f01d-4b28-9870-a1c6a372d716 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:35:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] VM Resumed (Lifecycle Event)
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:35:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance spawned successfully.
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:35:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019324.6601555, 00e60fe9-f01d-4b28-9870-a1c6a372d716 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:35:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] VM Started (Lifecycle Event)
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:35:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.objects.instance [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-f152d9be-33d2-4660-b92a-5fa1018d4cb5 req-eec0aeee-93e5-42de-bd6b-2950da37d356 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f152d9be-33d2-4660-b92a-5fa1018d4cb5 req-eec0aeee-93e5-42de-bd6b-2950da37d356 service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f152d9be-33d2-4660-b92a-5fa1018d4cb5 req-eec0aeee-93e5-42de-bd6b-2950da37d356 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f152d9be-33d2-4660-b92a-5fa1018d4cb5 req-eec0aeee-93e5-42de-bd6b-2950da37d356 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-f152d9be-33d2-4660-b92a-5fa1018d4cb5 req-eec0aeee-93e5-42de-bd6b-2950da37d356 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:24 user nova-compute[72520]: WARNING nova.compute.manager [req-f152d9be-33d2-4660-b92a-5fa1018d4cb5 req-eec0aeee-93e5-42de-bd6b-2950da37d356 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received unexpected event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with vm_state active and task_state rebuild_spawning.
Aug 02 23:35:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-51ae4d6a-ba58-417b-9d8a-9bcec87f28da tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:35:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:35:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:35:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:35:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing instance network info cache due to event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:35:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updated VIF entry in instance network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4cf07170-285c-466c-b6e2-fc171f61db19 req-2e9b2c24-1237-4913-aaed-015e9ab3a1a9 service nova] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:40 user nova-compute[72520]: INFO nova.compute.manager [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Shelve offloading
Aug 02 23:35:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-cda67cbd-09a7-4734-b581-85421bbac42d req-aa3cb655-d888-44ab-9678-ae9e6b3bcf8a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-unplugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cda67cbd-09a7-4734-b581-85421bbac42d req-aa3cb655-d888-44ab-9678-ae9e6b3bcf8a service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cda67cbd-09a7-4734-b581-85421bbac42d req-aa3cb655-d888-44ab-9678-ae9e6b3bcf8a service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cda67cbd-09a7-4734-b581-85421bbac42d req-aa3cb655-d888-44ab-9678-ae9e6b3bcf8a service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-cda67cbd-09a7-4734-b581-85421bbac42d req-aa3cb655-d888-44ab-9678-ae9e6b3bcf8a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-unplugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:40 user nova-compute[72520]: WARNING nova.compute.manager [req-cda67cbd-09a7-4734-b581-85421bbac42d req-aa3cb655-d888-44ab-9678-ae9e6b3bcf8a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received unexpected event network-vif-unplugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with vm_state active and task_state shelving.
Aug 02 23:35:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance destroyed successfully.
Aug 02 23:35:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:35:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:35:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:35:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:35:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:35:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance destroyed successfully.
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'resources' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-522014739',display_name='tempest-TestShelveInstance-server-522014739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-522014739',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJp8n8CjMYdw+emM0jJlP1dj7fHPmzowJCQY1NxYoD+ZAxLa2Nhh9dmWeHuX26M3Sx7M4UsRoHuPvqhDBTv/L1ldI7PEauy1C2jCN/2VvehlhV4D+zVTb318b3UAXM9lg==',key_name='tempest-TestShelveInstance-283917505',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccfc4fa5c29a48dc9021bbd09b4668f1',ramdisk_id='',reservation_id='r-i23tzsg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-171572139',owner_user_name='tempest-TestShelveInstance-171572139-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:04Z,user_data=None,user_id='a7420cb0556144b99ef811558ca21e17',uuid=a425b6aa-bb98-4b02-8263-571f8e1707c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converting VIF {"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_vif [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf7b293b-0a, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing instance network info cache due to event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.network.neutron [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:35:42 user nova-compute[72520]: INFO os_vif [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a')
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:35:42 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdda2826-ff87-41d6-abf7-a92ac025a14d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dfdcc5-b373-4894-84c6-fe0899404f11]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:35:42 user nova-compute[72520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:35:42 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:35:42 user nova-compute[72520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:35:42 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d07bbca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'): ({'sdj'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Removing single pathed devices sdj {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ac9119-fc21-48b5-b4ba-df86954b6214]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea232f69-2221-4a8e-b89b-e3d92ae5dd63]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Flushing IO for device /dev/sdj {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9d2725-a981-4e30-b5c1-3ddb8831e5f1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ded84e-30b6-47bc-a923-55f573ffc34f]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] SCSI volumes sdj have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63bf836-914c-4c45-ad5c-b2ba52ec98f6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85483be-de3e-4a66-b1b4-d8926bbf87f8]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]
Aug 02 23:35:42 user nova-compute[72520]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.
Aug 02 23:35:42 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5810ffb2-b6b4-4c77-ac02-808aab0bacf8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] <== disconnect_volume: return (344ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:35:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Deleting instance files /opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9_del
Aug 02 23:35:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Deletion of /opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9_del complete
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-80aada80-8b7f-4835-8834-6552cdff80f8 req-16941b4e-0770-48ad-8b9d-d6c08a332194 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-80aada80-8b7f-4835-8834-6552cdff80f8 req-16941b4e-0770-48ad-8b9d-d6c08a332194 service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-80aada80-8b7f-4835-8834-6552cdff80f8 req-16941b4e-0770-48ad-8b9d-d6c08a332194 service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-80aada80-8b7f-4835-8834-6552cdff80f8 req-16941b4e-0770-48ad-8b9d-d6c08a332194 service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-80aada80-8b7f-4835-8834-6552cdff80f8 req-16941b4e-0770-48ad-8b9d-d6c08a332194 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:35:42 user nova-compute[72520]: WARNING nova.compute.manager [req-80aada80-8b7f-4835-8834-6552cdff80f8 req-16941b4e-0770-48ad-8b9d-d6c08a332194 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received unexpected event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with vm_state active and task_state shelving.
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.network.neutron [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updated VIF entry in instance network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.network.neutron [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": null, "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c3c5ad78-8b21-4db5-bc95-f563022296eb req-b1a141b9-bd46-4102-8507-a0748146e17c service nova] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:43 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid 'a425b6aa-bb98-4b02-8263-571f8e1707c9' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a425b6aa-bb98-4b02-8263-571f8e1707c9' (instance-0000000b)
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:44 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:35:44 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:35:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=25.731647491455078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8e524afb-4d71-43a5-8b91-4f558c409237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b86f31d4-33c5-4b2b-a235-3b07b306f23a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a9fa9eda-ec05-4346-8694-89c2cd021663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 00e60fe9-f01d-4b28-9870-a1c6a372d716 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a425b6aa-bb98-4b02-8263-571f8e1707c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 049ff42c-34d8-4077-b995-537d58ccc8bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:35:45 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Deleted allocations for instance a425b6aa-bb98-4b02-8263-571f8e1707c9
Aug 02 23:35:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.100s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.objects.instance [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'numa_topology' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40ca93e1-60ce-4a11-a946-23f447e94314 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.430s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:35:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:47 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:35:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:35:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:56 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019341.0074427, a425b6aa-bb98-4b02-8263-571f8e1707c9 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:35:56 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] VM Stopped (Lifecycle Event)
Aug 02 23:35:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-bbc78897-eb8f-44ca-a4a5-60342cfcefb9 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:35:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:35:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:35:57 user nova-compute[72520]: INFO nova.compute.manager [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Detaching volume 0c0069b4-fbea-48be-a3e5-0e0434bb5aca
Aug 02 23:35:57 user nova-compute[72520]: INFO nova.virt.block_device [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Attempting to driver detach volume 0c0069b4-fbea-48be-a3e5-0e0434bb5aca from mountpoint /dev/vdb
Aug 02 23:35:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Attempting to detach device vdb from instance b86f31d4-33c5-4b2b-a235-3b07b306f23a from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:35:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:35:57 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:35:57 user nova-compute[72520]:   <source dev="/dev/sdh"/>
Aug 02 23:35:57 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:35:57 user nova-compute[72520]:   <serial>0c0069b4-fbea-48be-a3e5-0e0434bb5aca</serial>
Aug 02 23:35:57 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:35:57 user nova-compute[72520]: </disk>
Aug 02 23:35:57 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:35:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully detached device vdb from instance b86f31d4-33c5-4b2b-a235-3b07b306f23a from the persistent domain config.
Aug 02 23:35:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b86f31d4-33c5-4b2b-a235-3b07b306f23a from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:35:58 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:35:58 user nova-compute[72520]:   <source dev="/dev/sdh"/>
Aug 02 23:35:58 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:35:58 user nova-compute[72520]:   <serial>0c0069b4-fbea-48be-a3e5-0e0434bb5aca</serial>
Aug 02 23:35:58 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:35:58 user nova-compute[72520]: </disk>
Aug 02 23:35:58 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019358.5506577, b86f31d4-33c5-4b2b-a235-3b07b306f23a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b86f31d4-33c5-4b2b-a235-3b07b306f23a {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:35:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully detached device vdb from instance b86f31d4-33c5-4b2b-a235-3b07b306f23a from the live domain config.
Aug 02 23:35:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeSOULyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:35:58 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5fcb77-0cfb-424d-a9c3-a7873f9627ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b3fa1-e303-4ee9-bad7-c8621b48d751]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:35:58 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:35:58 user nova-compute[72520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca (non-flash)
Aug 02 23:35:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4652f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca'): ({'sdh'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Removing single pathed devices sdh {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f35cbc-bc10-4cdc-bff7-70459fde96ad]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1c9b6-dbed-4778-a667-ff626350bbde]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flushing IO for device /dev/sdh {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5b01a9-9521-4673-8a3b-dd6484e069ad]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a222d82-b3cd-417f-9ce4-4963e78d273e]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] SCSI volumes sdh have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b848d95e-8cd3-4712-83dc-a689597f151f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1af158-7dce-44e7-93cb-61f87c2bc2c6]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260]
Aug 02 23:35:58 user nova-compute[72520]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca, portal: 172.16.0.220,3260] successful.
Aug 02 23:35:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c0069b4-fbea-48be-a3e5-0e0434bb5aca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c531b8-d1bf-4918-ae1b-694e66aa493e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== disconnect_volume: return (284ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:35:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:36:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid b86f31d4-33c5-4b2b-a235-3b07b306f23a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0c3be566-14e2-473d-a2f3-d284dc3ad988 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.362s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "049ff42c-34d8-4077-b995-537d58ccc8bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:15 user nova-compute[72520]: INFO nova.compute.manager [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Terminating instance
Aug 02 23:36:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:36:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-8317d081-0a76-4033-b194-913c88ea717f req-75ce4737-a0f8-4bcf-8e2c-88f3c91c1cf4 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received event network-vif-unplugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8317d081-0a76-4033-b194-913c88ea717f req-75ce4737-a0f8-4bcf-8e2c-88f3c91c1cf4 service nova] Acquiring lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8317d081-0a76-4033-b194-913c88ea717f req-75ce4737-a0f8-4bcf-8e2c-88f3c91c1cf4 service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8317d081-0a76-4033-b194-913c88ea717f req-75ce4737-a0f8-4bcf-8e2c-88f3c91c1cf4 service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-8317d081-0a76-4033-b194-913c88ea717f req-75ce4737-a0f8-4bcf-8e2c-88f3c91c1cf4 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] No waiting events found dispatching network-vif-unplugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-8317d081-0a76-4033-b194-913c88ea717f req-75ce4737-a0f8-4bcf-8e2c-88f3c91c1cf4 service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received event network-vif-unplugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:36:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Instance destroyed successfully.
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.objects.instance [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'resources' on Instance uuid 049ff42c-34d8-4077-b995-537d58ccc8bd {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-347882388',display_name='tempest-VolumesAdminNegativeTest-server-347882388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-347882388',id=12,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3748be8ace1d41ba8508d59f8f8373d8',ramdisk_id='',reservation_id='r-wnnawdsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-662521094',owner_user_name='tempest-VolumesAdminNegativeTest-662521094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:22Z,user_data=None,user_id='cc828569cbd645fab326233e841d2494',uuid=049ff42c-34d8-4077-b995-537d58ccc8bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converting VIF {"id": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "address": "fa:16:3e:7a:ab:56", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc5593-aa", "ovs_interfaceid": "6cbc5593-aa72-4cfe-8d15-4c7c99618b07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=6cbc5593-aa72-4cfe-8d15-4c7c99618b07,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc5593-aa') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG os_vif [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=6cbc5593-aa72-4cfe-8d15-4c7c99618b07,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc5593-aa') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cbc5593-aa, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:16 user nova-compute[72520]: INFO os_vif [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=6cbc5593-aa72-4cfe-8d15-4c7c99618b07,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc5593-aa')
Aug 02 23:36:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Deleting instance files /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd_del
Aug 02 23:36:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Deletion of /opt/stack/data/nova/instances/049ff42c-34d8-4077-b995-537d58ccc8bd_del complete
Aug 02 23:36:16 user nova-compute[72520]: INFO nova.compute.manager [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 02 23:36:16 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:36:16 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:36:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:17 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:17 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Took 0.94 seconds to deallocate network for instance.
Aug 02 23:36:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-7b6b96d9-cd3d-49c9-b18f-ccb156bc2208 req-29fc1e81-4506-4623-9c45-a7eea10ff0ab service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received event network-vif-deleted-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:17 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:17 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Deleted allocations for instance 049ff42c-34d8-4077-b995-537d58ccc8bd
Aug 02 23:36:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-859f4490-9300-45b1-89ae-2e944a2502f9 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:18 user nova-compute[72520]: DEBUG nova.compute.manager [req-2066b590-da3c-46cb-b81d-9785928079e7 req-3cae5d66-3214-49d8-9ca1-3609d08e8fdd service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received event network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2066b590-da3c-46cb-b81d-9785928079e7 req-3cae5d66-3214-49d8-9ca1-3609d08e8fdd service nova] Acquiring lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2066b590-da3c-46cb-b81d-9785928079e7 req-3cae5d66-3214-49d8-9ca1-3609d08e8fdd service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2066b590-da3c-46cb-b81d-9785928079e7 req-3cae5d66-3214-49d8-9ca1-3609d08e8fdd service nova] Lock "049ff42c-34d8-4077-b995-537d58ccc8bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:18 user nova-compute[72520]: DEBUG nova.compute.manager [req-2066b590-da3c-46cb-b81d-9785928079e7 req-3cae5d66-3214-49d8-9ca1-3609d08e8fdd service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] No waiting events found dispatching network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:18 user nova-compute[72520]: WARNING nova.compute.manager [req-2066b590-da3c-46cb-b81d-9785928079e7 req-3cae5d66-3214-49d8-9ca1-3609d08e8fdd service nova] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Received unexpected event network-vif-plugged-6cbc5593-aa72-4cfe-8d15-4c7c99618b07 for instance with vm_state deleted and task_state None.
Aug 02 23:36:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "da91726a-77ee-4d02-b6eb-a95389edc413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:36:22 user nova-compute[72520]: INFO nova.compute.claims [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Claim successful on node user
Aug 02 23:36:22 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:36:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:36:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Creating image(s)
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "/opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "/opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "/opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.policy [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0eb2a1daad5c4ca1a08a05a96f35abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486a2f0c16c04ebba565665cae279a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.129s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk 1073741824" returned: 0 in 0.049s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.126s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Cannot resize image /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.objects.instance [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lazy-loading 'migration_context' on Instance uuid da91726a-77ee-4d02-b6eb-a95389edc413 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Ensure instance console log exists: /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Successfully created port: c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:36:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG nova.network.neutron [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Successfully updated port: c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "refresh_cache-da91726a-77ee-4d02-b6eb-a95389edc413" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquired lock "refresh_cache-da91726a-77ee-4d02-b6eb-a95389edc413" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG nova.network.neutron [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received event network-changed-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Refreshing instance network info cache due to event network-changed-c5b96bf2-5b6c-4a00-98a6-b0f08198651f. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:36:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] Acquiring lock "refresh_cache-da91726a-77ee-4d02-b6eb-a95389edc413" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.network.neutron [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.network.neutron [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Updating instance_info_cache with network_info: [{"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Releasing lock "refresh_cache-da91726a-77ee-4d02-b6eb-a95389edc413" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Instance network_info: |[{"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] Acquired lock "refresh_cache-da91726a-77ee-4d02-b6eb-a95389edc413" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.network.neutron [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Refreshing network info cache for port c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Start _get_guest_xml network_info=[{"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:36:27 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:27 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-776953486',display_name='tempest-VolumesNegativeTest-instance-776953486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-776953486',id=15,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='486a2f0c16c04ebba565665cae279a6d',ramdisk_id='',reservation_id='r-a6ukf9l5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1564259388',owner_user_name='tempest-VolumesNegativeTest-1564259388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:23Z,user_data=None,user_id='0eb2a1daad5c4ca1a08a05a96f35abe4',uuid=da91726a-77ee-4d02-b6eb-a95389edc413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Converting VIF {"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:5e:38,bridge_name='br-int',has_traffic_filtering=True,id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f,network=Network(2172d0fb-86c9-415a-810b-4078de26c0ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b96bf2-5b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.objects.instance [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lazy-loading 'pci_devices' on Instance uuid da91726a-77ee-4d02-b6eb-a95389edc413 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:36:27 user nova-compute[72520]:   <uuid>da91726a-77ee-4d02-b6eb-a95389edc413</uuid>
Aug 02 23:36:27 user nova-compute[72520]:   <name>instance-0000000f</name>
Aug 02 23:36:27 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:36:27 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:36:27 user nova-compute[72520]:   <metadata>
Aug 02 23:36:27 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:27 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:36:27 user nova-compute[72520]:       <nova:name>tempest-VolumesNegativeTest-instance-776953486</nova:name>
Aug 02 23:36:27 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:36:27</nova:creationTime>
Aug 02 23:36:27 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:36:27 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:36:27 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:36:27 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:36:27 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:27 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:27 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:36:27 user nova-compute[72520]:       <nova:owner>
Aug 02 23:36:27 user nova-compute[72520]:         <nova:user uuid="0eb2a1daad5c4ca1a08a05a96f35abe4">tempest-VolumesNegativeTest-1564259388-project-member</nova:user>
Aug 02 23:36:27 user nova-compute[72520]:         <nova:project uuid="486a2f0c16c04ebba565665cae279a6d">tempest-VolumesNegativeTest-1564259388</nova:project>
Aug 02 23:36:27 user nova-compute[72520]:       </nova:owner>
Aug 02 23:36:27 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:27 user nova-compute[72520]:       <nova:ports>
Aug 02 23:36:27 user nova-compute[72520]:         <nova:port uuid="c5b96bf2-5b6c-4a00-98a6-b0f08198651f">
Aug 02 23:36:27 user nova-compute[72520]:           <nova:ip type="fixed" address="192.168.233.69" ipVersion="4"/>
Aug 02 23:36:27 user nova-compute[72520]:         </nova:port>
Aug 02 23:36:27 user nova-compute[72520]:       </nova:ports>
Aug 02 23:36:27 user nova-compute[72520]:     </nova:instance>
Aug 02 23:36:27 user nova-compute[72520]:   </metadata>
Aug 02 23:36:27 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:36:27 user nova-compute[72520]:     <system>
Aug 02 23:36:27 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:36:27 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:36:27 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:36:27 user nova-compute[72520]:       <entry name="serial">da91726a-77ee-4d02-b6eb-a95389edc413</entry>
Aug 02 23:36:27 user nova-compute[72520]:       <entry name="uuid">da91726a-77ee-4d02-b6eb-a95389edc413</entry>
Aug 02 23:36:27 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:36:27 user nova-compute[72520]:     </system>
Aug 02 23:36:27 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:27 user nova-compute[72520]:   <os>
Aug 02 23:36:27 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:36:27 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:36:27 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:36:27 user nova-compute[72520]:   </os>
Aug 02 23:36:27 user nova-compute[72520]:   <features>
Aug 02 23:36:27 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:27 user nova-compute[72520]:     <apic/>
Aug 02 23:36:27 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:36:27 user nova-compute[72520]:   </features>
Aug 02 23:36:27 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:36:27 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:36:27 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:36:27 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:36:27 user nova-compute[72520]:   </clock>
Aug 02 23:36:27 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:36:27 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:36:27 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:36:27 user nova-compute[72520]:   </cpu>
Aug 02 23:36:27 user nova-compute[72520]:   <devices>
Aug 02 23:36:27 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:36:27 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:36:27 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk"/>
Aug 02 23:36:27 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:36:27 user nova-compute[72520]:     </disk>
Aug 02 23:36:27 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:36:27 user nova-compute[72520]:       <mac address="fa:16:3e:27:5e:38"/>
Aug 02 23:36:27 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:27 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:36:27 user nova-compute[72520]:       <target dev="tapc5b96bf2-5b"/>
Aug 02 23:36:27 user nova-compute[72520]:     </interface>
Aug 02 23:36:27 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:36:27 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/console.log" append="off"/>
Aug 02 23:36:27 user nova-compute[72520]:     </serial>
Aug 02 23:36:27 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:36:27 user nova-compute[72520]:     <video>
Aug 02 23:36:27 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:27 user nova-compute[72520]:     </video>
Aug 02 23:36:27 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:36:27 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:36:27 user nova-compute[72520]:     </rng>
Aug 02 23:36:27 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:36:27 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:36:27 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:36:27 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:27 user nova-compute[72520]:   </devices>
Aug 02 23:36:27 user nova-compute[72520]: </domain>
Aug 02 23:36:27 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-776953486',display_name='tempest-VolumesNegativeTest-instance-776953486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-776953486',id=15,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='486a2f0c16c04ebba565665cae279a6d',ramdisk_id='',reservation_id='r-a6ukf9l5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1564259388',owner_user_name='tempest-VolumesNegativeTest-1564259388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:23Z,user_data=None,user_id='0eb2a1daad5c4ca1a08a05a96f35abe4',uuid=da91726a-77ee-4d02-b6eb-a95389edc413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Converting VIF {"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:5e:38,bridge_name='br-int',has_traffic_filtering=True,id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f,network=Network(2172d0fb-86c9-415a-810b-4078de26c0ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b96bf2-5b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG os_vif [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:5e:38,bridge_name='br-int',has_traffic_filtering=True,id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f,network=Network(2172d0fb-86c9-415a-810b-4078de26c0ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b96bf2-5b') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5b96bf2-5b, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5b96bf2-5b, col_values=(('external_ids', {'iface-id': 'c5b96bf2-5b6c-4a00-98a6-b0f08198651f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:5e:38', 'vm-uuid': 'da91726a-77ee-4d02-b6eb-a95389edc413'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:27 user nova-compute[72520]: INFO os_vif [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:5e:38,bridge_name='br-int',has_traffic_filtering=True,id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f,network=Network(2172d0fb-86c9-415a-810b-4078de26c0ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b96bf2-5b')
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] No VIF found with MAC fa:16:3e:27:5e:38, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:36:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:28 user nova-compute[72520]: DEBUG nova.network.neutron [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Updated VIF entry in instance network info cache for port c5b96bf2-5b6c-4a00-98a6-b0f08198651f. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:36:28 user nova-compute[72520]: DEBUG nova.network.neutron [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Updating instance_info_cache with network_info: [{"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-399e443f-1efe-4529-9400-333ebce4f0d9 req-00065553-5485-4b20-816f-5c132c9d20ec service nova] Releasing lock "refresh_cache-da91726a-77ee-4d02-b6eb-a95389edc413" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-d5145525-dd29-4dd1-b90a-466ef672061f req-72ba7834-9640-4ccb-bce3-d09c179cea8d service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received event network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d5145525-dd29-4dd1-b90a-466ef672061f req-72ba7834-9640-4ccb-bce3-d09c179cea8d service nova] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d5145525-dd29-4dd1-b90a-466ef672061f req-72ba7834-9640-4ccb-bce3-d09c179cea8d service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d5145525-dd29-4dd1-b90a-466ef672061f req-72ba7834-9640-4ccb-bce3-d09c179cea8d service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-d5145525-dd29-4dd1-b90a-466ef672061f req-72ba7834-9640-4ccb-bce3-d09c179cea8d service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] No waiting events found dispatching network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:29 user nova-compute[72520]: WARNING nova.compute.manager [req-d5145525-dd29-4dd1-b90a-466ef672061f req-72ba7834-9640-4ccb-bce3-d09c179cea8d service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received unexpected event network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f for instance with vm_state building and task_state spawning.
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.compute.manager [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-changed-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.compute.manager [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Refreshing instance network info cache due to event network-changed-dfa77141-b84f-4751-9f42-f6678520df71. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] Acquiring lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] Acquired lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Refreshing network info cache for port dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updated VIF entry in instance network info cache for port dfa77141-b84f-4751-9f42-f6678520df71. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-be408a57-926e-4872-8cdc-8e8b42f27c84 req-87a09577-3c0c-4b39-a62d-87068c855a7e service nova] Releasing lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:36:30 user nova-compute[72520]: INFO nova.compute.claims [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Claim successful on node user
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "interface-1c3580dd-23d0-4402-9a56-730e4c9f4bf8-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "interface-1c3580dd-23d0-4402-9a56-730e4c9f4bf8-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:30 user nova-compute[72520]: DEBUG nova.objects.instance [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'flavor' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.objects.instance [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'pci_requests' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.network.neutron [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.policy [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbb520874684447d8894c00ae4f5359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f9e2d14a0b4abab0b07d282a808c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019391.3039417, da91726a-77ee-4d02-b6eb-a95389edc413 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] VM Resumed (Lifecycle Event)
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Instance spawned successfully.
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.network.neutron [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019391.3042653, da91726a-77ee-4d02-b6eb-a95389edc413 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] VM Started (Lifecycle Event)
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019376.4060202, 049ff42c-34d8-4077-b995-537d58ccc8bd => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] VM Stopped (Lifecycle Event)
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "23931909-81f4-44fb-b936-10a27c16febb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.policy [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd02269696a0d47738d8daa53d44b3b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb887059a9634cce9f17319a980a18f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d74b855e-2634-4f5a-b372-f69c420241d7 None None] [instance: 049ff42c-34d8-4077-b995-537d58ccc8bd] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Took 8.34 seconds to spawn the instance on the hypervisor.
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Creating image(s)
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.manager [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Took 9.01 seconds to build instance.
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:36:31 user nova-compute[72520]: INFO nova.compute.claims [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Claim successful on node user
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-456d65d1-dd3f-4cb5-89ab-cac8f2eb2aa9 req-6a8d758d-45e5-499f-8f4a-cd612bd8679f service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received event network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-456d65d1-dd3f-4cb5-89ab-cac8f2eb2aa9 req-6a8d758d-45e5-499f-8f4a-cd612bd8679f service nova] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-456d65d1-dd3f-4cb5-89ab-cac8f2eb2aa9 req-6a8d758d-45e5-499f-8f4a-cd612bd8679f service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-456d65d1-dd3f-4cb5-89ab-cac8f2eb2aa9 req-6a8d758d-45e5-499f-8f4a-cd612bd8679f service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-456d65d1-dd3f-4cb5-89ab-cac8f2eb2aa9 req-6a8d758d-45e5-499f-8f4a-cd612bd8679f service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] No waiting events found dispatching network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:31 user nova-compute[72520]: WARNING nova.compute.manager [req-456d65d1-dd3f-4cb5-89ab-cac8f2eb2aa9 req-6a8d758d-45e5-499f-8f4a-cd612bd8679f service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received unexpected event network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f for instance with vm_state active and task_state None.
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04bd00ba-fe7c-41c6-acd9-3a94483e0698 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "da91726a-77ee-4d02-b6eb-a95389edc413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.106s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG nova.network.neutron [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Successfully created port: 73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.168s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk 1073741824" returned: 0 in 0.051s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.network.neutron [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Successfully created port: adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Cannot resize image /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'migration_context' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Ensure instance console log exists: /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:36:32 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:36:32 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Creating image(s)
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.policy [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd02269696a0d47738d8daa53d44b3b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb887059a9634cce9f17319a980a18f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.network.neutron [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Successfully updated port: 73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.160s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquired lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.network.neutron [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.compute.manager [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-changed-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG nova.compute.manager [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Refreshing instance network info cache due to event network-changed-73bb1e41-bec9-4cea-bfce-563493c28c1c. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] Acquiring lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk 1073741824" returned: 0 in 0.049s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Cannot resize image /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'migration_context' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Ensure instance console log exists: /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.network.neutron [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Releasing lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] Acquired lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.network.neutron [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Refreshing network info cache for port 73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converting VIF {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG os_vif [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73bb1e41-be, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73bb1e41-be, col_values=(('external_ids', {'iface-id': '73bb1e41-bec9-4cea-bfce-563493c28c1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:5d:2a', 'vm-uuid': '1c3580dd-23d0-4402-9a56-730e4c9f4bf8'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:33 user nova-compute[72520]: INFO os_vif [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be')
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converting VIF {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] attach device xml: <interface type="ethernet">
Aug 02 23:36:33 user nova-compute[72520]:   <mac address="fa:16:3e:d9:5d:2a"/>
Aug 02 23:36:33 user nova-compute[72520]:   <model type="virtio"/>
Aug 02 23:36:33 user nova-compute[72520]:   <mtu size="1442"/>
Aug 02 23:36:33 user nova-compute[72520]:   <target dev="tap73bb1e41-be"/>
Aug 02 23:36:33 user nova-compute[72520]: </interface>
Aug 02 23:36:33 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-changed-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Refreshing instance network info cache due to event network-changed-e6621ff4-2e1e-4c89-877e-a05152ee45aa. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] Acquiring lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] Acquired lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:33 user nova-compute[72520]: DEBUG nova.network.neutron [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Refreshing network info cache for port e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No BDM found with device name hda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No VIF found with MAC fa:16:3e:65:74:e4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:34 user nova-compute[72520]:   <nova:package version="0.0.0"/>
Aug 02 23:36:34 user nova-compute[72520]:   <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:36:34 user nova-compute[72520]:   <nova:creationTime>2023-08-02 23:36:34</nova:creationTime>
Aug 02 23:36:34 user nova-compute[72520]:   <nova:flavor name="m1.tiny">
Aug 02 23:36:34 user nova-compute[72520]:     <nova:memory>512</nova:memory>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:disk>1</nova:disk>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:swap>0</nova:swap>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:34 user nova-compute[72520]:   </nova:flavor>
Aug 02 23:36:34 user nova-compute[72520]:   <nova:owner>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:36:34 user nova-compute[72520]:   </nova:owner>
Aug 02 23:36:34 user nova-compute[72520]:   <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:34 user nova-compute[72520]:   <nova:ports>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:36:34 user nova-compute[72520]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:36:34 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:34 user nova-compute[72520]:     <nova:port uuid="73bb1e41-bec9-4cea-bfce-563493c28c1c">
Aug 02 23:36:34 user nova-compute[72520]:       <nova:ip type="fixed" address="10.10.10.227" ipVersion="4"/>
Aug 02 23:36:34 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:34 user nova-compute[72520]:   </nova:ports>
Aug 02 23:36:34 user nova-compute[72520]: </nova:instance>
Aug 02 23:36:34 user nova-compute[72520]:  {{(pid=72520) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-90f2fca2-d0c4-49f9-b162-7d025389a7e6 tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "interface-1c3580dd-23d0-4402-9a56-730e4c9f4bf8-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.275s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-439d1509-070a-489c-a762-9b1fa774fd52 req-6eac2d62-f4d2-4545-9e7f-fc23e3a01d37 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-439d1509-070a-489c-a762-9b1fa774fd52 req-6eac2d62-f4d2-4545-9e7f-fc23e3a01d37 service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-439d1509-070a-489c-a762-9b1fa774fd52 req-6eac2d62-f4d2-4545-9e7f-fc23e3a01d37 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-439d1509-070a-489c-a762-9b1fa774fd52 req-6eac2d62-f4d2-4545-9e7f-fc23e3a01d37 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-439d1509-070a-489c-a762-9b1fa774fd52 req-6eac2d62-f4d2-4545-9e7f-fc23e3a01d37 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:34 user nova-compute[72520]: WARNING nova.compute.manager [req-439d1509-070a-489c-a762-9b1fa774fd52 req-6eac2d62-f4d2-4545-9e7f-fc23e3a01d37 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c for instance with vm_state active and task_state None.
Aug 02 23:36:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.network.neutron [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updated VIF entry in instance network info cache for port 73bb1e41-bec9-4cea-bfce-563493c28c1c. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.network.neutron [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-82d480fd-5ad3-4940-83b3-78575326e971 req-84e7af8e-b21c-4a68-a0b0-e1ab842b15d1 service nova] Releasing lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'flavor' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.network.neutron [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Successfully updated port: adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.network.neutron [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updated VIF entry in instance network info cache for port e6621ff4-2e1e-4c89-877e-a05152ee45aa. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.network.neutron [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating instance_info_cache with network_info: [{"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.214s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2872cb-779f-4af3-8095-b05fdb01ac5a req-b68891ae-aade-4fc8-b0fe-2e2e7254c77a service nova] Releasing lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:34 user nova-compute[72520]: DEBUG nova.network.neutron [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.network.neutron [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Successfully created port: 1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:35 user nova-compute[72520]: INFO nova.compute.manager [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Attaching volume e082e890-75d0-4e04-b8a8-30bb1926bd8c to /dev/vdb
Aug 02 23:36:35 user nova-compute[72520]: DEBUG os_brick.utils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecaa739-a17e-4a79-9907-da2f7cfe57e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc70acb-2630-4255-89c1-30cab8194677]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fed9f9-5b31-4ff8-8fc2-dfcc7f7cacbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da712473-7f22-4857-abcb-404813dfbc08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.network.neutron [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:36:35 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31353b9e-488a-4511-8670-f35da1d1140a]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG os_brick.utils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating existing volume attachment record: a8f07c24-42d4-421b-b841-3546073e7480 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance network_info: |[{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Start _get_guest_xml network_info=[{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:36:35 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:35 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944685915',display_name='tempest-ServerRescueNegativeTestJSON-server-944685915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944685915',id=16,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-5exu2j08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:31Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.objects.instance [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'pci_devices' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:36:35 user nova-compute[72520]:   <uuid>f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf</uuid>
Aug 02 23:36:35 user nova-compute[72520]:   <name>instance-00000010</name>
Aug 02 23:36:35 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:36:35 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:36:35 user nova-compute[72520]:   <metadata>
Aug 02 23:36:35 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:35 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:36:35 user nova-compute[72520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-944685915</nova:name>
Aug 02 23:36:35 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:36:35</nova:creationTime>
Aug 02 23:36:35 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:36:35 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:36:35 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:36:35 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:36:35 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:35 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:35 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:36:35 user nova-compute[72520]:       <nova:owner>
Aug 02 23:36:35 user nova-compute[72520]:         <nova:user uuid="d02269696a0d47738d8daa53d44b3b70">tempest-ServerRescueNegativeTestJSON-1442912244-project-member</nova:user>
Aug 02 23:36:35 user nova-compute[72520]:         <nova:project uuid="cb887059a9634cce9f17319a980a18f4">tempest-ServerRescueNegativeTestJSON-1442912244</nova:project>
Aug 02 23:36:35 user nova-compute[72520]:       </nova:owner>
Aug 02 23:36:35 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:35 user nova-compute[72520]:       <nova:ports>
Aug 02 23:36:35 user nova-compute[72520]:         <nova:port uuid="adfb39f0-4b80-4170-b389-d4d0fe8cd860">
Aug 02 23:36:35 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:36:35 user nova-compute[72520]:         </nova:port>
Aug 02 23:36:35 user nova-compute[72520]:       </nova:ports>
Aug 02 23:36:35 user nova-compute[72520]:     </nova:instance>
Aug 02 23:36:35 user nova-compute[72520]:   </metadata>
Aug 02 23:36:35 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:36:35 user nova-compute[72520]:     <system>
Aug 02 23:36:35 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:36:35 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:36:35 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:36:35 user nova-compute[72520]:       <entry name="serial">f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf</entry>
Aug 02 23:36:35 user nova-compute[72520]:       <entry name="uuid">f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf</entry>
Aug 02 23:36:35 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:36:35 user nova-compute[72520]:     </system>
Aug 02 23:36:35 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:35 user nova-compute[72520]:   <os>
Aug 02 23:36:35 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:36:35 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:36:35 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:36:35 user nova-compute[72520]:   </os>
Aug 02 23:36:35 user nova-compute[72520]:   <features>
Aug 02 23:36:35 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:35 user nova-compute[72520]:     <apic/>
Aug 02 23:36:35 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:36:35 user nova-compute[72520]:   </features>
Aug 02 23:36:35 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:36:35 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:36:35 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:36:35 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:36:35 user nova-compute[72520]:   </clock>
Aug 02 23:36:35 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:36:35 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:36:35 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:36:35 user nova-compute[72520]:   </cpu>
Aug 02 23:36:35 user nova-compute[72520]:   <devices>
Aug 02 23:36:35 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:36:35 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:36:35 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk"/>
Aug 02 23:36:35 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:36:35 user nova-compute[72520]:     </disk>
Aug 02 23:36:35 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:36:35 user nova-compute[72520]:       <mac address="fa:16:3e:de:bc:6e"/>
Aug 02 23:36:35 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:35 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:36:35 user nova-compute[72520]:       <target dev="tapadfb39f0-4b"/>
Aug 02 23:36:35 user nova-compute[72520]:     </interface>
Aug 02 23:36:35 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:36:35 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/console.log" append="off"/>
Aug 02 23:36:35 user nova-compute[72520]:     </serial>
Aug 02 23:36:35 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:36:35 user nova-compute[72520]:     <video>
Aug 02 23:36:35 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:35 user nova-compute[72520]:     </video>
Aug 02 23:36:35 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:36:35 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:36:35 user nova-compute[72520]:     </rng>
Aug 02 23:36:35 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:36:35 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:36:35 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:36:35 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:35 user nova-compute[72520]:   </devices>
Aug 02 23:36:35 user nova-compute[72520]: </domain>
Aug 02 23:36:35 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944685915',display_name='tempest-ServerRescueNegativeTestJSON-server-944685915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944685915',id=16,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-5exu2j08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:31Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG os_vif [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadfb39f0-4b, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadfb39f0-4b, col_values=(('external_ids', {'iface-id': 'adfb39f0-4b80-4170-b389-d4d0fe8cd860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:bc:6e', 'vm-uuid': 'f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:35 user nova-compute[72520]: INFO os_vif [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b')
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No VIF found with MAC fa:16:3e:de:bc:6e, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Successfully updated port: 1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-changed-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Refreshing instance network info cache due to event network-changed-adfb39f0-4b80-4170-b389-d4d0fe8cd860. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] Acquiring lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] Acquired lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.network.neutron [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Refreshing network info cache for port adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updating instance_info_cache with network_info: [{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance network_info: |[{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Start _get_guest_xml network_info=[{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.network.neutron [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updated VIF entry in instance network info cache for port adfb39f0-4b80-4170-b389-d4d0fe8cd860. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:36:36 user nova-compute[72520]: DEBUG nova.network.neutron [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:36 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:37 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] Releasing lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.compute.manager [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.compute.manager [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:37 user nova-compute[72520]: WARNING nova.compute.manager [req-86784bbb-26c1-4922-9503-3bc92bb9794d req-c0575e08-daaa-4459-b2a4-18ef181bb5f6 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c for instance with vm_state active and task_state None.
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1365006288',display_name='tempest-ServerRescueNegativeTestJSON-server-1365006288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1365006288',id=17,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-xocj6gh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:32Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=23931909-81f4-44fb-b936-10a27c16febb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'pci_devices' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:36:37 user nova-compute[72520]:   <uuid>23931909-81f4-44fb-b936-10a27c16febb</uuid>
Aug 02 23:36:37 user nova-compute[72520]:   <name>instance-00000011</name>
Aug 02 23:36:37 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:36:37 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:36:37 user nova-compute[72520]:   <metadata>
Aug 02 23:36:37 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:37 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:36:37 user nova-compute[72520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1365006288</nova:name>
Aug 02 23:36:37 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:36:37</nova:creationTime>
Aug 02 23:36:37 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:36:37 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:36:37 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:36:37 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:36:37 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:37 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:37 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:36:37 user nova-compute[72520]:       <nova:owner>
Aug 02 23:36:37 user nova-compute[72520]:         <nova:user uuid="d02269696a0d47738d8daa53d44b3b70">tempest-ServerRescueNegativeTestJSON-1442912244-project-member</nova:user>
Aug 02 23:36:37 user nova-compute[72520]:         <nova:project uuid="cb887059a9634cce9f17319a980a18f4">tempest-ServerRescueNegativeTestJSON-1442912244</nova:project>
Aug 02 23:36:37 user nova-compute[72520]:       </nova:owner>
Aug 02 23:36:37 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:37 user nova-compute[72520]:       <nova:ports>
Aug 02 23:36:37 user nova-compute[72520]:         <nova:port uuid="1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72">
Aug 02 23:36:37 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 02 23:36:37 user nova-compute[72520]:         </nova:port>
Aug 02 23:36:37 user nova-compute[72520]:       </nova:ports>
Aug 02 23:36:37 user nova-compute[72520]:     </nova:instance>
Aug 02 23:36:37 user nova-compute[72520]:   </metadata>
Aug 02 23:36:37 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:36:37 user nova-compute[72520]:     <system>
Aug 02 23:36:37 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:36:37 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:36:37 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:36:37 user nova-compute[72520]:       <entry name="serial">23931909-81f4-44fb-b936-10a27c16febb</entry>
Aug 02 23:36:37 user nova-compute[72520]:       <entry name="uuid">23931909-81f4-44fb-b936-10a27c16febb</entry>
Aug 02 23:36:37 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:36:37 user nova-compute[72520]:     </system>
Aug 02 23:36:37 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:37 user nova-compute[72520]:   <os>
Aug 02 23:36:37 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:36:37 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:36:37 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:36:37 user nova-compute[72520]:   </os>
Aug 02 23:36:37 user nova-compute[72520]:   <features>
Aug 02 23:36:37 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:37 user nova-compute[72520]:     <apic/>
Aug 02 23:36:37 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:36:37 user nova-compute[72520]:   </features>
Aug 02 23:36:37 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:36:37 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:36:37 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:36:37 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:36:37 user nova-compute[72520]:   </clock>
Aug 02 23:36:37 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:36:37 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:36:37 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:36:37 user nova-compute[72520]:   </cpu>
Aug 02 23:36:37 user nova-compute[72520]:   <devices>
Aug 02 23:36:37 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:36:37 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:36:37 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk"/>
Aug 02 23:36:37 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:36:37 user nova-compute[72520]:     </disk>
Aug 02 23:36:37 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:36:37 user nova-compute[72520]:       <mac address="fa:16:3e:a2:15:80"/>
Aug 02 23:36:37 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:37 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:36:37 user nova-compute[72520]:       <target dev="tap1a9d8d42-40"/>
Aug 02 23:36:37 user nova-compute[72520]:     </interface>
Aug 02 23:36:37 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:36:37 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/console.log" append="off"/>
Aug 02 23:36:37 user nova-compute[72520]:     </serial>
Aug 02 23:36:37 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:36:37 user nova-compute[72520]:     <video>
Aug 02 23:36:37 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:37 user nova-compute[72520]:     </video>
Aug 02 23:36:37 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:36:37 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:36:37 user nova-compute[72520]:     </rng>
Aug 02 23:36:37 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:36:37 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:36:37 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:36:37 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:37 user nova-compute[72520]:   </devices>
Aug 02 23:36:37 user nova-compute[72520]: </domain>
Aug 02 23:36:37 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1365006288',display_name='tempest-ServerRescueNegativeTestJSON-server-1365006288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1365006288',id=17,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-xocj6gh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:32Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=23931909-81f4-44fb-b936-10a27c16febb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG os_vif [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a9d8d42-40, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a9d8d42-40, col_values=(('external_ids', {'iface-id': '1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:15:80', 'vm-uuid': '23931909-81f4-44fb-b936-10a27c16febb'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: INFO os_vif [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40')
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No VIF found with MAC fa:16:3e:a2:15:80, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.compute.manager [req-20219384-54b7-43f0-af30-f3f7e4a4884a req-b7adae12-78bf-4a5d-b968-622ff23ea599 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-20219384-54b7-43f0-af30-f3f7e4a4884a req-b7adae12-78bf-4a5d-b968-622ff23ea599 service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-20219384-54b7-43f0-af30-f3f7e4a4884a req-b7adae12-78bf-4a5d-b968-622ff23ea599 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-20219384-54b7-43f0-af30-f3f7e4a4884a req-b7adae12-78bf-4a5d-b968-622ff23ea599 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG nova.compute.manager [req-20219384-54b7-43f0-af30-f3f7e4a4884a req-b7adae12-78bf-4a5d-b968-622ff23ea599 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:37 user nova-compute[72520]: WARNING nova.compute.manager [req-20219384-54b7-43f0-af30-f3f7e4a4884a req-b7adae12-78bf-4a5d-b968-622ff23ea599 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state building and task_state spawning.
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-changed-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Refreshing instance network info cache due to event network-changed-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] Acquiring lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] Acquired lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG nova.network.neutron [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Refreshing network info cache for port 1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:36:38 user nova-compute[72520]: INFO nova.compute.claims [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Claim successful on node user
Aug 02 23:36:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:38 user nova-compute[72520]: INFO nova.compute.manager [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attaching volume 9331027c-5850-42c0-9dec-034ae18c058b to /dev/vdb
Aug 02 23:36:38 user nova-compute[72520]: DEBUG os_brick.utils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0764e8-8a3a-424f-95b8-c14c87530451]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78704f0d-eb02-4f0f-81c7-9e9bdd8fdaa3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77d3215-5afc-4405-a2cf-b3e0f142cb09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a1c6d3-0b22-42db-96bb-1428cdf9a1d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:36:39 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f582222-4718-4310-bd04-5cabd595624e]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG os_brick.utils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating existing volume attachment record: faf80eb3-2b3c-4b06-9976-2d7c01e3a588 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updated VIF entry in instance network info cache for port 1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updating instance_info_cache with network_info: [{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-9f2d101e-8037-4009-bfff-5460393893fc req-22cca138-d810-4f02-ba0c-5b10f8c98925 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9f2d101e-8037-4009-bfff-5460393893fc req-22cca138-d810-4f02-ba0c-5b10f8c98925 service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9f2d101e-8037-4009-bfff-5460393893fc req-22cca138-d810-4f02-ba0c-5b10f8c98925 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9f2d101e-8037-4009-bfff-5460393893fc req-22cca138-d810-4f02-ba0c-5b10f8c98925 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-9f2d101e-8037-4009-bfff-5460393893fc req-22cca138-d810-4f02-ba0c-5b10f8c98925 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:39 user nova-compute[72520]: WARNING nova.compute.manager [req-9f2d101e-8037-4009-bfff-5460393893fc req-22cca138-d810-4f02-ba0c-5b10f8c98925 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state building and task_state spawning.
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.883s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08f48ebd-b11c-46d2-902a-78efb8cba266 req-35f253ec-f626-4887-af03-f82d3e1d043a service nova] Releasing lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:36:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.policy [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3ecb56ac3554ee3b1ef658d9cdd3869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542e5ab2d59245f58d357cf688e30a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:36:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Creating image(s)
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk 1073741824" returned: 0 in 0.055s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.160s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Successfully created port: 45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Cannot resize image /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.objects.instance [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'migration_context' on Instance uuid 0e13bfd1-68d9-442a-b95b-40caaa10586c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:40 user nova-compute[72520]: WARNING nova.compute.manager [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received unexpected event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with vm_state building and task_state spawning.
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:40 user nova-compute[72520]: WARNING nova.compute.manager [req-73de7c8c-8092-416b-adb7-67e3adaac8f1 req-16aaf7c2-06d5-43e1-93a2-01d10e98ec14 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received unexpected event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with vm_state building and task_state spawning.
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Ensure instance console log exists: /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019400.7515492, f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:40 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] VM Resumed (Lifecycle Event)
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:36:40 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance spawned successfully.
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:40 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019400.752852, f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:40 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] VM Started (Lifecycle Event)
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:40 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:40 user nova-compute[72520]: INFO nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Took 9.32 seconds to spawn the instance on the hypervisor.
Aug 02 23:36:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:40 user nova-compute[72520]: INFO nova.compute.manager [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Took 10.21 seconds to build instance.
Aug 02 23:36:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-adaa1f35-a043-41ff-9772-ba3f07fd498e tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.322s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019401.2019875, 23931909-81f4-44fb-b936-10a27c16febb => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] VM Resumed (Lifecycle Event)
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:36:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance spawned successfully.
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019401.2059257, 23931909-81f4-44fb-b936-10a27c16febb => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] VM Started (Lifecycle Event)
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:41 user nova-compute[72520]: INFO nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Took 8.76 seconds to spawn the instance on the hypervisor.
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Successfully updated port: 45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Skipping network cache update for instance because it is Building. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Skipping network cache update for instance because it is Building. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 02 23:36:41 user nova-compute[72520]: INFO nova.compute.manager [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Took 9.90 seconds to build instance.
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ace2cc31-4f5d-47f3-b8de-8d65fa91544f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "23931909-81f4-44fb-b936-10a27c16febb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.023s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 8e524afb-4d71-43a5-8b91-4f558c409237 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updating instance_info_cache with network_info: [{"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Instance network_info: |[{"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Start _get_guest_xml network_info=[{"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:36:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-589631707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-589631707',id=18,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-du80d9d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:40Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=0e13bfd1-68d9-442a-b95b-40caaa10586c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:91:59,bridge_name='br-int',has_traffic_filtering=True,id=45376fd7-ad38-407d-8b13-3843586a4e63,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45376fd7-ad') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.objects.instance [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e13bfd1-68d9-442a-b95b-40caaa10586c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:36:41 user nova-compute[72520]:   <uuid>0e13bfd1-68d9-442a-b95b-40caaa10586c</uuid>
Aug 02 23:36:41 user nova-compute[72520]:   <name>instance-00000012</name>
Aug 02 23:36:41 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:36:41 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:36:41 user nova-compute[72520]:   <metadata>
Aug 02 23:36:41 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:41 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:36:41 user nova-compute[72520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-589631707</nova:name>
Aug 02 23:36:41 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:36:41</nova:creationTime>
Aug 02 23:36:41 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:36:41 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:36:41 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:36:41 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:36:41 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:41 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:41 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:36:41 user nova-compute[72520]:       <nova:owner>
Aug 02 23:36:41 user nova-compute[72520]:         <nova:user uuid="f3ecb56ac3554ee3b1ef658d9cdd3869">tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member</nova:user>
Aug 02 23:36:41 user nova-compute[72520]:         <nova:project uuid="542e5ab2d59245f58d357cf688e30a43">tempest-ServerBootFromVolumeStableRescueTest-1108272558</nova:project>
Aug 02 23:36:41 user nova-compute[72520]:       </nova:owner>
Aug 02 23:36:41 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:41 user nova-compute[72520]:       <nova:ports>
Aug 02 23:36:41 user nova-compute[72520]:         <nova:port uuid="45376fd7-ad38-407d-8b13-3843586a4e63">
Aug 02 23:36:41 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:36:41 user nova-compute[72520]:         </nova:port>
Aug 02 23:36:41 user nova-compute[72520]:       </nova:ports>
Aug 02 23:36:41 user nova-compute[72520]:     </nova:instance>
Aug 02 23:36:41 user nova-compute[72520]:   </metadata>
Aug 02 23:36:41 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:36:41 user nova-compute[72520]:     <system>
Aug 02 23:36:41 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:36:41 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:36:41 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:36:41 user nova-compute[72520]:       <entry name="serial">0e13bfd1-68d9-442a-b95b-40caaa10586c</entry>
Aug 02 23:36:41 user nova-compute[72520]:       <entry name="uuid">0e13bfd1-68d9-442a-b95b-40caaa10586c</entry>
Aug 02 23:36:41 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:36:41 user nova-compute[72520]:     </system>
Aug 02 23:36:41 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:41 user nova-compute[72520]:   <os>
Aug 02 23:36:41 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:36:41 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:36:41 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:36:41 user nova-compute[72520]:   </os>
Aug 02 23:36:41 user nova-compute[72520]:   <features>
Aug 02 23:36:41 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:41 user nova-compute[72520]:     <apic/>
Aug 02 23:36:41 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:36:41 user nova-compute[72520]:   </features>
Aug 02 23:36:41 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:36:41 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:36:41 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:36:41 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:36:41 user nova-compute[72520]:   </clock>
Aug 02 23:36:41 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:36:41 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:36:41 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:36:41 user nova-compute[72520]:   </cpu>
Aug 02 23:36:41 user nova-compute[72520]:   <devices>
Aug 02 23:36:41 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:36:41 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:36:41 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk"/>
Aug 02 23:36:41 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:36:41 user nova-compute[72520]:     </disk>
Aug 02 23:36:41 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:36:41 user nova-compute[72520]:       <mac address="fa:16:3e:81:91:59"/>
Aug 02 23:36:41 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:41 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:36:41 user nova-compute[72520]:       <target dev="tap45376fd7-ad"/>
Aug 02 23:36:41 user nova-compute[72520]:     </interface>
Aug 02 23:36:41 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:36:41 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/console.log" append="off"/>
Aug 02 23:36:41 user nova-compute[72520]:     </serial>
Aug 02 23:36:41 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:36:41 user nova-compute[72520]:     <video>
Aug 02 23:36:41 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:36:41 user nova-compute[72520]:     </video>
Aug 02 23:36:41 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:36:41 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:36:41 user nova-compute[72520]:     </rng>
Aug 02 23:36:41 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:36:41 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:36:41 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:36:41 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:41 user nova-compute[72520]:   </devices>
Aug 02 23:36:41 user nova-compute[72520]: </domain>
Aug 02 23:36:41 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-589631707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-589631707',id=18,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-du80d9d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:40Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=0e13bfd1-68d9-442a-b95b-40caaa10586c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:91:59,bridge_name='br-int',has_traffic_filtering=True,id=45376fd7-ad38-407d-8b13-3843586a4e63,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45376fd7-ad') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG os_vif [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:91:59,bridge_name='br-int',has_traffic_filtering=True,id=45376fd7-ad38-407d-8b13-3843586a4e63,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45376fd7-ad') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45376fd7-ad, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45376fd7-ad, col_values=(('external_ids', {'iface-id': '45376fd7-ad38-407d-8b13-3843586a4e63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:91:59', 'vm-uuid': '0e13bfd1-68d9-442a-b95b-40caaa10586c'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:41 user nova-compute[72520]: INFO os_vif [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:91:59,bridge_name='br-int',has_traffic_filtering=True,id=45376fd7-ad38-407d-8b13-3843586a4e63,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45376fd7-ad')
Aug 02 23:36:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No VIF found with MAC fa:16:3e:81:91:59, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updating instance_info_cache with network_info: [{"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-8e524afb-4d71-43a5-8b91-4f558c409237" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-changed-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Refreshing instance network info cache due to event network-changed-45376fd7-ad38-407d-8b13-3843586a4e63. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] Acquiring lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] Acquired lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:42 user nova-compute[72520]: DEBUG nova.network.neutron [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Refreshing network info cache for port 45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updated VIF entry in instance network info cache for port 45376fd7-ad38-407d-8b13-3843586a4e63. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updating instance_info_cache with network_info: [{"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9c052549-10e9-4a76-864c-750cddff8e02 req-a7b5ae38-65f1-4bd7-9bdf-9709669076ce service nova] Releasing lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:43 user nova-compute[72520]: INFO nova.compute.manager [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Terminating instance
Aug 02 23:36:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-91593980-de5c-4ee9-9216-f8478aa5b5c6 req-76472e1c-0034-4a55-8b90-8ae7cad08144 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-unplugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91593980-de5c-4ee9-9216-f8478aa5b5c6 req-76472e1c-0034-4a55-8b90-8ae7cad08144 service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91593980-de5c-4ee9-9216-f8478aa5b5c6 req-76472e1c-0034-4a55-8b90-8ae7cad08144 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-91593980-de5c-4ee9-9216-f8478aa5b5c6 req-76472e1c-0034-4a55-8b90-8ae7cad08144 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-91593980-de5c-4ee9-9216-f8478aa5b5c6 req-76472e1c-0034-4a55-8b90-8ae7cad08144 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-unplugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-91593980-de5c-4ee9-9216-f8478aa5b5c6 req-76472e1c-0034-4a55-8b90-8ae7cad08144 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-unplugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQXMRjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:36:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:36:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:36:44 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba1581-d9df-485a-969b-34eba6a587ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:36:44 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[be643a88-ce0f-4c6f-a636-af057b89c545]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c] added
Aug 02 23:36:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9419d9ce-b2d9-4ea5-b364-e6bbc0a70277]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a89cb6-43c9-4104-8cde-bdbf3bc1ef1e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFQXMRjB {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFQXMRjB" returned: 0 in 0.045s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4211368d-6e62-4396-b873-815dc1350ecd]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EFQXMRjB'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Instance destroyed successfully.
Aug 02 23:36:44 user nova-compute[72520]: DEBUG nova.objects.instance [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'resources' on Instance uuid 00e60fe9-f01d-4b28-9870-a1c6a372d716 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.044s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca04f234-0380-4c0b-8990-42154837603a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1247750399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1542430789',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqvLzVCkT8bvzftZb7AMDtHeOMmBeFF4frxcylAlJx/jSrTkfK6q1ipNE5vvyJL659Jqn7d5hR74At3igrlIj99nJf8DtlmKuHNmRx79SKYiGCP4W7B16NyaDt7cZEv5Q==',key_name='tempest-keypair-57639330',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:35:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-y0imkgwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=00e60fe9-f01d-4b28-9870-a1c6a372d716,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "address": "fa:16:3e:c1:eb:0f", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d45074-4f", "ovs_interfaceid": "35d45074-4fe3-44a2-a7f7-9f6c4057ae4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_vif [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d45074-4f, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: INFO os_vif [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:eb:0f,bridge_name='br-int',has_traffic_filtering=True,id=35d45074-4fe3-44a2-a7f7-9f6c4057ae4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d45074-4f')
Aug 02 23:36:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqwaCmAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:36:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9127ca3b-3096-40c6-980d-33a81196834a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:36:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:36:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ede7a-d5f8-4cab-9f1d-579a8edc7dea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260]
Aug 02 23:36:44 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260] successful.
Aug 02 23:36:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22bde3d-1bca-45c7-81b8-894c6694bf9b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03982d43-df1c-41b4-8e07-f377413b26fb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:36:44 user nova-compute[72520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:36:44 user nova-compute[72520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13485503-5746-49fe-bc6d-f1f70ca53787]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQXMRjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23765386639336538', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765386639336538', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.183s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.objects.instance [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'flavor' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8f6a6-b90c-4c5c-9bc6-5d935f90bd7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:36:45 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:36:45 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:36:45 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:36:45 user nova-compute[72520]:   <serial>e082e890-75d0-4e04-b8a8-30bb1926bd8c</serial>
Aug 02 23:36:45 user nova-compute[72520]: </disk>
Aug 02 23:36:45 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Acquiring lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] No waiting events found dispatching network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:45 user nova-compute[72520]: WARNING nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received unexpected event network-vif-plugged-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e for instance with vm_state active and task_state deleting.
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:45 user nova-compute[72520]: WARNING nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received unexpected event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with vm_state building and task_state spawning.
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:45 user nova-compute[72520]: WARNING nova.compute.manager [req-4846b215-004e-42a8-a95e-c7dcdb76e2e4 req-27652fac-632c-4a12-bedc-e3f386dc88f9 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received unexpected event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with vm_state building and task_state spawning.
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce330a-83da-4835-b6b4-460ca64e1345]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:36:45 user nova-compute[72520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f (non-flash)
Aug 02 23:36:45 user nova-compute[72520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4233490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb6d6b-117b-4d30-bfcf-b00fd9f22a74]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586823b-dc5c-42cc-a8ac-d2021b50d8a1]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c98a2-d290-48f0-adb1-7dd6ed6ffd2a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14295b4f-4584-4815-ab53-4371b33a8b75]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb6f449-73b4-4845-87cb-4ee3b40a87b7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b4c8f-e3c0-4138-9097-ec6615b63f19]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260]
Aug 02 23:36:46 user nova-compute[72520]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f, portal: 172.16.0.220,3260] successful.
Aug 02 23:36:46 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b19b835-a22d-474e-9aa6-a003b53c151f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.092s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da03761-f239-488e-a898-70aebb3873c4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] <== disconnect_volume: return (1581ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:36:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Deleting instance files /opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716_del
Aug 02 23:36:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Deletion of /opt/stack/data/nova/instances/00e60fe9-f01d-4b28-9870-a1c6a372d716_del complete
Aug 02 23:36:46 user nova-compute[72520]: INFO nova.compute.manager [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Took 2.93 seconds to destroy the instance on the hypervisor.
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No BDM found with device name hda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] No VIF found with MAC fa:16:3e:65:74:e4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-524cdb4c-73fc-4860-959e-43a225e115bc tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.417s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019406.9303892, 0e13bfd1-68d9-442a-b95b-40caaa10586c => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] VM Resumed (Lifecycle Event)
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:36:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Instance spawned successfully.
Aug 02 23:36:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:36:47 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019406.9310586, 0e13bfd1-68d9-442a-b95b-40caaa10586c => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:47 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] VM Started (Lifecycle Event)
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:36:47 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:47 user nova-compute[72520]: INFO nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Took 7.29 seconds to spawn the instance on the hypervisor.
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:47 user nova-compute[72520]: INFO nova.compute.manager [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Took 8.65 seconds to build instance.
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-167978b5-f18c-4e95-9b3c-9409c4750f58 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.772s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:36:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:48 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Took 1.84 seconds to deallocate network for instance.
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.compute.manager [req-10e62200-e335-4ad0-949a-7d1668ce3684 req-fb93722b-f321-4400-8c46-0c6e900f2367 service nova] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Received event network-vif-deleted-35d45074-4fe3-44a2-a7f7-9f6c4057ae4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:48 user nova-compute[72520]: INFO nova.compute.manager [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Terminating instance
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lhWPEugf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:36:48 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:36:48 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:36:48 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c2fd7f-6559-40e6-839e-93301e0a9704]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:36:48 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a5d45-3bcf-4f2c-b7e9-7403c0dcc7d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b] added
Aug 02 23:36:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: INFO nova.compute.manager [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Detaching volume e082e890-75d0-4e04-b8a8-30bb1926bd8c
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eae9b1-c940-4718-b9ef-75b1f784f8ef]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44df486e-74b6-4ab5-ad04-90a7b0cdb0b9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: INFO nova.virt.block_device [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Attempting to driver detach volume e082e890-75d0-4e04-b8a8-30bb1926bd8c from mountpoint /dev/vdb
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lhWPEugf {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lhWPEugf" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[993458d7-1063-4e6a-a5a8-3e84b3cbef99]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lhWPEugf'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Attempting to detach device vdb from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:36:48 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:36:48 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:36:48 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:36:48 user nova-compute[72520]:   <serial>e082e890-75d0-4e04-b8a8-30bb1926bd8c</serial>
Aug 02 23:36:48 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 02 23:36:48 user nova-compute[72520]: </disk>
Aug 02 23:36:48 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:36:48 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully detached device vdb from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the persistent domain config.
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:36:48 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:36:48 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:36:48 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:36:48 user nova-compute[72520]:   <serial>e082e890-75d0-4e04-b8a8-30bb1926bd8c</serial>
Aug 02 23:36:48 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 02 23:36:48 user nova-compute[72520]: </disk>
Aug 02 23:36:48 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c9acf8-49c6-436e-b9dc-48f8a1494ed7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb8d47-1a02-400e-832a-de8dd71ef123]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f695af39-b3a4-4f13-8b13-6a83933b5ad1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260]
Aug 02 23:36:48 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260] successful.
Aug 02 23:36:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e8b6b6-608a-4bcf-ad38-cb590c3db67e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[745525f0-4b82-4525-96f3-7cc503f08216]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:48 user nova-compute[72520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)
Aug 02 23:36:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:48 user nova-compute[72520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)
Aug 02 23:36:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.540s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f12f46d-adb0-4124-9ca0-1a285132d9f7]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:36:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lhWPEugf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:49 user nova-compute[72520]: INFO nova.compute.manager [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Took 1.10 seconds to detach 1 volumes for instance.
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Deleting volume: 9b19b835-a22d-474e-9aa6-a003b53c151f {{(pid=72520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019409.2730956, 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:36:49 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully detached device vdb from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the live domain config.
Aug 02 23:36:49 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Instance destroyed successfully.
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.objects.instance [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'resources' on Instance uuid b86f31d4-33c5-4b2b-a235-3b07b306f23a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQXMRjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:36:49 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:36:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-279902656',display_name='tempest-AttachVolumeNegativeTest-server-279902656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-279902656',id=3,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn0BZiujVN+LS36VveXKFJEU+CUFYo49Y6/UfcWGZHzXQg9G4hNqytGTtyySdjvukp+epM7mpTcbf+WEuVs61CzN29omP6pBqisxDasn0hF8Yaez/dbi9LkscfoBSki7g==',key_name='tempest-keypair-1147761571',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-oq32vyu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=b86f31d4-33c5-4b2b-a235-3b07b306f23a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "address": "fa:16:3e:ec:eb:8b", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40ffeb06-68", "ovs_interfaceid": "40ffeb06-6826-4533-a120-3b8d6b7570b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:eb:8b,bridge_name='br-int',has_traffic_filtering=True,id=40ffeb06-6826-4533-a120-3b8d6b7570b7,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ffeb06-68') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG os_vif [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:eb:8b,bridge_name='br-int',has_traffic_filtering=True,id=40ffeb06-6826-4533-a120-3b8d6b7570b7,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ffeb06-68') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40ffeb06-68, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:49 user nova-compute[72520]: INFO os_vif [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:eb:8b,bridge_name='br-int',has_traffic_filtering=True,id=40ffeb06-6826-4533-a120-3b8d6b7570b7,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40ffeb06-68')
Aug 02 23:36:49 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Deleting instance files /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a_del
Aug 02 23:36:49 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Deletion of /opt/stack/data/nova/instances/b86f31d4-33c5-4b2b-a235-3b07b306f23a_del complete
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:49 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid '00e60fe9-f01d-4b28-9870-a1c6a372d716' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid '00e60fe9-f01d-4b28-9870-a1c6a372d716' (instance-00000009)
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:49 user nova-compute[72520]: INFO nova.compute.manager [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.998s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== connect_volume: return (2002ms) {'type': 'block', 'scsi_wwn': '26265636666323264', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265636666323264', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-vif-unplugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] No waiting events found dispatching network-vif-unplugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-vif-unplugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] Acquiring lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] No waiting events found dispatching network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:50 user nova-compute[72520]: WARNING nova.compute.manager [req-5c7d838f-830f-484e-a33b-bfa74d2bbf7e req-a7ece624-d6c3-431c-ad65-3031c752f20f service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received unexpected event network-vif-plugged-40ffeb06-6826-4533-a120-3b8d6b7570b7 for instance with vm_state active and task_state deleting.
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.996s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=25.72624969482422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91261a4b-7973-4fb4-a7c3-661cbd436207]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.101s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.051s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac5fb30-e1e7-4819-b4d0-d6203e7bfacd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:50 user nova-compute[72520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)
Aug 02 23:36:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c (non-flash)
Aug 02 23:36:50 user nova-compute[72520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)
Aug 02 23:36:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4233010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:36:50 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:36:50 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:36:50 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:36:50 user nova-compute[72520]:   <serial>9331027c-5850-42c0-9dec-034ae18c058b</serial>
Aug 02 23:36:50 user nova-compute[72520]: </disk>
Aug 02 23:36:50 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[431c148e-17c6-436b-a2a9-678d80f87895]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Deleted allocations for instance 00e60fe9-f01d-4b28-9870-a1c6a372d716
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f333f9-8df4-4840-9e8e-0063d574aae4]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3049cd60-69b7-40a3-a12b-31019ed1f3c8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0a03ef-b302-461f-8555-7e253b996229]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9c63292e-fe43-4e9f-96e1-6a27edcb76dd tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "00e60fe9-f01d-4b28-9870-a1c6a372d716" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.400s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ffde6-cbec-412d-9dc8-ee46abdd80a7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 8e524afb-4d71-43a5-8b91-4f558c409237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b86f31d4-33c5-4b2b-a235-3b07b306f23a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a9fa9eda-ec05-4346-8694-89c2cd021663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance da91726a-77ee-4d02-b6eb-a95389edc413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebb2d51-ecab-49af-905f-d4e415c7b950]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260]
Aug 02 23:36:50 user nova-compute[72520]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c, portal: 172.16.0.220,3260] successful.
Aug 02 23:36:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082e890-75d0-4e04-b8a8-30bb1926bd8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[470b149f-7faf-42c1-8a2a-0a6e61c407b4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] <== disconnect_volume: return (1449ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:36:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No VIF found with MAC fa:16:3e:98:7d:b0, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:36:51 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Took 1.59 seconds to deallocate network for instance.
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.788s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.034s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b099cd30-0a4c-46c0-accc-2b832f5da97d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.330s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:51 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Deleted allocations for instance b86f31d4-33c5-4b2b-a235-3b07b306f23a
Aug 02 23:36:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-02b37b22-8667-42a1-88af-dd5b82e9dbb5 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "b86f31d4-33c5-4b2b-a235-3b07b306f23a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.452s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-34a0f873-7c5e-4e19-a46e-2e090e975c77 req-09e02ff5-3148-4966-b915-58bf0dfdc7e8 service nova] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Received event network-vif-deleted-40ffeb06-6826-4533-a120-3b8d6b7570b7 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:36:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:36:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'flavor' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-42cff4ff-551d-4247-8394-edabdce2d40a tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.092s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "interface-1c3580dd-23d0-4402-9a56-730e4c9f4bf8-73bb1e41-bec9-4cea-bfce-563493c28c1c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "interface-1c3580dd-23d0-4402-9a56-730e4c9f4bf8-73bb1e41-bec9-4cea-bfce-563493c28c1c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.objects.instance [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'flavor' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converting VIF {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface> {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface> {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Attempting to detach device tap73bb1e41-be from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] detach device xml: <interface type="ethernet">
Aug 02 23:36:58 user nova-compute[72520]:   <mac address="fa:16:3e:d9:5d:2a"/>
Aug 02 23:36:58 user nova-compute[72520]:   <model type="virtio"/>
Aug 02 23:36:58 user nova-compute[72520]:   <mtu size="1442"/>
Aug 02 23:36:58 user nova-compute[72520]:   <target dev="tap73bb1e41-be"/>
Aug 02 23:36:58 user nova-compute[72520]: </interface>
Aug 02 23:36:58 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface> {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 02 23:36:58 user nova-compute[72520]:   <name>instance-0000000d</name>
Aug 02 23:36:58 user nova-compute[72520]:   <uuid>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</uuid>
Aug 02 23:36:58 user nova-compute[72520]:   <metadata>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:58 user nova-compute[72520]:   <nova:package version="0.0.0"/>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:creationTime>2023-08-02 23:36:34</nova:creationTime>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:flavor name="m1.tiny">
Aug 02 23:36:58 user nova-compute[72520]:     <nova:memory>512</nova:memory>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:disk>1</nova:disk>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:swap>0</nova:swap>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:flavor>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:owner>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:owner>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:ports>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:36:58 user nova-compute[72520]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:36:58 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:port uuid="73bb1e41-bec9-4cea-bfce-563493c28c1c">
Aug 02 23:36:58 user nova-compute[72520]:       <nova:ip type="fixed" address="10.10.10.227" ipVersion="4"/>
Aug 02 23:36:58 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:ports>
Aug 02 23:36:58 user nova-compute[72520]: </nova:instance>
Aug 02 23:36:58 user nova-compute[72520]:   </metadata>
Aug 02 23:36:58 user nova-compute[72520]:   <memory unit='KiB'>524288</memory>
Aug 02 23:36:58 user nova-compute[72520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 02 23:36:58 user nova-compute[72520]:   <vcpu placement='static'>1</vcpu>
Aug 02 23:36:58 user nova-compute[72520]:   <resource>
Aug 02 23:36:58 user nova-compute[72520]:     <partition>/machine</partition>
Aug 02 23:36:58 user nova-compute[72520]:   </resource>
Aug 02 23:36:58 user nova-compute[72520]:   <sysinfo type='smbios'>
Aug 02 23:36:58 user nova-compute[72520]:     <system>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='product'>OpenStack Nova</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='version'>0.0.0</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='serial'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='uuid'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='family'>Virtual Machine</entry>
Aug 02 23:36:58 user nova-compute[72520]:     </system>
Aug 02 23:36:58 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:58 user nova-compute[72520]:   <os>
Aug 02 23:36:58 user nova-compute[72520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 02 23:36:58 user nova-compute[72520]:     <boot dev='hd'/>
Aug 02 23:36:58 user nova-compute[72520]:     <smbios mode='sysinfo'/>
Aug 02 23:36:58 user nova-compute[72520]:   </os>
Aug 02 23:36:58 user nova-compute[72520]:   <features>
Aug 02 23:36:58 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:58 user nova-compute[72520]:     <apic/>
Aug 02 23:36:58 user nova-compute[72520]:     <vmcoreinfo state='on'/>
Aug 02 23:36:58 user nova-compute[72520]:   </features>
Aug 02 23:36:58 user nova-compute[72520]:   <cpu mode='custom' match='exact' check='full'>
Aug 02 23:36:58 user nova-compute[72520]:     <model fallback='forbid'>Nehalem</model>
Aug 02 23:36:58 user nova-compute[72520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 02 23:36:58 user nova-compute[72520]:     <feature policy='require' name='vme'/>
Aug 02 23:36:58 user nova-compute[72520]:     <feature policy='require' name='x2apic'/>
Aug 02 23:36:58 user nova-compute[72520]:     <feature policy='require' name='hypervisor'/>
Aug 02 23:36:58 user nova-compute[72520]:   </cpu>
Aug 02 23:36:58 user nova-compute[72520]:   <clock offset='utc'>
Aug 02 23:36:58 user nova-compute[72520]:     <timer name='pit' tickpolicy='delay'/>
Aug 02 23:36:58 user nova-compute[72520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 02 23:36:58 user nova-compute[72520]:     <timer name='hpet' present='no'/>
Aug 02 23:36:58 user nova-compute[72520]:   </clock>
Aug 02 23:36:58 user nova-compute[72520]:   <on_poweroff>destroy</on_poweroff>
Aug 02 23:36:58 user nova-compute[72520]:   <on_reboot>restart</on_reboot>
Aug 02 23:36:58 user nova-compute[72520]:   <on_crash>destroy</on_crash>
Aug 02 23:36:58 user nova-compute[72520]:   <devices>
Aug 02 23:36:58 user nova-compute[72520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 02 23:36:58 user nova-compute[72520]:     <disk type='file' device='disk'>
Aug 02 23:36:58 user nova-compute[72520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 02 23:36:58 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk' index='2'/>
Aug 02 23:36:58 user nova-compute[72520]:       <backingStore type='file' index='3'>
Aug 02 23:36:58 user nova-compute[72520]:         <format type='raw'/>
Aug 02 23:36:58 user nova-compute[72520]:         <source file='/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab'/>
Aug 02 23:36:58 user nova-compute[72520]:         <backingStore/>
Aug 02 23:36:58 user nova-compute[72520]:       </backingStore>
Aug 02 23:36:58 user nova-compute[72520]:       <target dev='vda' bus='virtio'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='virtio-disk0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </disk>
Aug 02 23:36:58 user nova-compute[72520]:     <disk type='file' device='cdrom'>
Aug 02 23:36:58 user nova-compute[72520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 02 23:36:58 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config' index='1'/>
Aug 02 23:36:58 user nova-compute[72520]:       <backingStore/>
Aug 02 23:36:58 user nova-compute[72520]:       <target dev='hda' bus='ide'/>
Aug 02 23:36:58 user nova-compute[72520]:       <readonly/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='ide0-0-0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </disk>
Aug 02 23:36:58 user nova-compute[72520]:     <controller type='usb' index='0' model='none'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='usb'/>
Aug 02 23:36:58 user nova-compute[72520]:     </controller>
Aug 02 23:36:58 user nova-compute[72520]:     <controller type='pci' index='0' model='pci-root'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='pci.0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </controller>
Aug 02 23:36:58 user nova-compute[72520]:     <controller type='ide' index='0'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='ide'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 02 23:36:58 user nova-compute[72520]:     </controller>
Aug 02 23:36:58 user nova-compute[72520]:     <interface type='ethernet'>
Aug 02 23:36:58 user nova-compute[72520]:       <mac address='fa:16:3e:65:74:e4'/>
Aug 02 23:36:58 user nova-compute[72520]:       <target dev='tapdfa77141-b8'/>
Aug 02 23:36:58 user nova-compute[72520]:       <model type='virtio'/>
Aug 02 23:36:58 user nova-compute[72520]:       <mtu size='1442'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='net0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </interface>
Aug 02 23:36:58 user nova-compute[72520]:     <interface type='ethernet'>
Aug 02 23:36:58 user nova-compute[72520]:       <mac address='fa:16:3e:d9:5d:2a'/>
Aug 02 23:36:58 user nova-compute[72520]:       <target dev='tap73bb1e41-be'/>
Aug 02 23:36:58 user nova-compute[72520]:       <model type='virtio'/>
Aug 02 23:36:58 user nova-compute[72520]:       <mtu size='1442'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='net1'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </interface>
Aug 02 23:36:58 user nova-compute[72520]:     <serial type='pty'>
Aug 02 23:36:58 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:58 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:58 user nova-compute[72520]:       <target type='isa-serial' port='0'>
Aug 02 23:36:58 user nova-compute[72520]:         <model name='isa-serial'/>
Aug 02 23:36:58 user nova-compute[72520]:       </target>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </serial>
Aug 02 23:36:58 user nova-compute[72520]:     <console type='pty' tty='/dev/pts/9'>
Aug 02 23:36:58 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:58 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:58 user nova-compute[72520]:       <target type='serial' port='0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </console>
Aug 02 23:36:58 user nova-compute[72520]:     <input type='mouse' bus='ps2'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='input0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </input>
Aug 02 23:36:58 user nova-compute[72520]:     <input type='keyboard' bus='ps2'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='input1'/>
Aug 02 23:36:58 user nova-compute[72520]:     </input>
Aug 02 23:36:58 user nova-compute[72520]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 02 23:36:58 user nova-compute[72520]:       <listen type='address' address='0.0.0.0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </graphics>
Aug 02 23:36:58 user nova-compute[72520]:     <audio id='1' type='none'/>
Aug 02 23:36:58 user nova-compute[72520]:     <video>
Aug 02 23:36:58 user nova-compute[72520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='video0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </video>
Aug 02 23:36:58 user nova-compute[72520]:     <memballoon model='virtio'>
Aug 02 23:36:58 user nova-compute[72520]:       <stats period='10'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='balloon0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:58 user nova-compute[72520]:     <rng model='virtio'>
Aug 02 23:36:58 user nova-compute[72520]:       <backend model='random'>/dev/urandom</backend>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='rng0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </rng>
Aug 02 23:36:58 user nova-compute[72520]:   </devices>
Aug 02 23:36:58 user nova-compute[72520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 02 23:36:58 user nova-compute[72520]:     <label>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</label>
Aug 02 23:36:58 user nova-compute[72520]:     <imagelabel>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</imagelabel>
Aug 02 23:36:58 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:58 user nova-compute[72520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 02 23:36:58 user nova-compute[72520]:     <label>+64055:+108</label>
Aug 02 23:36:58 user nova-compute[72520]:     <imagelabel>+64055:+108</imagelabel>
Aug 02 23:36:58 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:58 user nova-compute[72520]: </domain>
Aug 02 23:36:58 user nova-compute[72520]:  {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 02 23:36:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully detached device tap73bb1e41-be from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the persistent domain config.
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] (1/8): Attempting to detach device tap73bb1e41-be with device alias net1 from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] detach device xml: <interface type="ethernet">
Aug 02 23:36:58 user nova-compute[72520]:   <mac address="fa:16:3e:d9:5d:2a"/>
Aug 02 23:36:58 user nova-compute[72520]:   <model type="virtio"/>
Aug 02 23:36:58 user nova-compute[72520]:   <mtu size="1442"/>
Aug 02 23:36:58 user nova-compute[72520]:   <target dev="tap73bb1e41-be"/>
Aug 02 23:36:58 user nova-compute[72520]: </interface>
Aug 02 23:36:58 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019418.7520754, 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Start waiting for the detach event from libvirt for device tap73bb1e41-be with device alias net1 for instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface> {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 02 23:36:58 user nova-compute[72520]:   <name>instance-0000000d</name>
Aug 02 23:36:58 user nova-compute[72520]:   <uuid>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</uuid>
Aug 02 23:36:58 user nova-compute[72520]:   <metadata>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:58 user nova-compute[72520]:   <nova:package version="0.0.0"/>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:creationTime>2023-08-02 23:36:34</nova:creationTime>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:flavor name="m1.tiny">
Aug 02 23:36:58 user nova-compute[72520]:     <nova:memory>512</nova:memory>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:disk>1</nova:disk>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:swap>0</nova:swap>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:flavor>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:owner>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:owner>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:ports>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:36:58 user nova-compute[72520]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:36:58 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:port uuid="73bb1e41-bec9-4cea-bfce-563493c28c1c">
Aug 02 23:36:58 user nova-compute[72520]:       <nova:ip type="fixed" address="10.10.10.227" ipVersion="4"/>
Aug 02 23:36:58 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:ports>
Aug 02 23:36:58 user nova-compute[72520]: </nova:instance>
Aug 02 23:36:58 user nova-compute[72520]:   </metadata>
Aug 02 23:36:58 user nova-compute[72520]:   <memory unit='KiB'>524288</memory>
Aug 02 23:36:58 user nova-compute[72520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 02 23:36:58 user nova-compute[72520]:   <vcpu placement='static'>1</vcpu>
Aug 02 23:36:58 user nova-compute[72520]:   <resource>
Aug 02 23:36:58 user nova-compute[72520]:     <partition>/machine</partition>
Aug 02 23:36:58 user nova-compute[72520]:   </resource>
Aug 02 23:36:58 user nova-compute[72520]:   <sysinfo type='smbios'>
Aug 02 23:36:58 user nova-compute[72520]:     <system>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='product'>OpenStack Nova</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='version'>0.0.0</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='serial'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='uuid'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:58 user nova-compute[72520]:       <entry name='family'>Virtual Machine</entry>
Aug 02 23:36:58 user nova-compute[72520]:     </system>
Aug 02 23:36:58 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:58 user nova-compute[72520]:   <os>
Aug 02 23:36:58 user nova-compute[72520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 02 23:36:58 user nova-compute[72520]:     <boot dev='hd'/>
Aug 02 23:36:58 user nova-compute[72520]:     <smbios mode='sysinfo'/>
Aug 02 23:36:58 user nova-compute[72520]:   </os>
Aug 02 23:36:58 user nova-compute[72520]:   <features>
Aug 02 23:36:58 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:58 user nova-compute[72520]:     <apic/>
Aug 02 23:36:58 user nova-compute[72520]:     <vmcoreinfo state='on'/>
Aug 02 23:36:58 user nova-compute[72520]:   </features>
Aug 02 23:36:58 user nova-compute[72520]:   <cpu mode='custom' match='exact' check='full'>
Aug 02 23:36:58 user nova-compute[72520]:     <model fallback='forbid'>Nehalem</model>
Aug 02 23:36:58 user nova-compute[72520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 02 23:36:58 user nova-compute[72520]:     <feature policy='require' name='vme'/>
Aug 02 23:36:58 user nova-compute[72520]:     <feature policy='require' name='x2apic'/>
Aug 02 23:36:58 user nova-compute[72520]:     <feature policy='require' name='hypervisor'/>
Aug 02 23:36:58 user nova-compute[72520]:   </cpu>
Aug 02 23:36:58 user nova-compute[72520]:   <clock offset='utc'>
Aug 02 23:36:58 user nova-compute[72520]:     <timer name='pit' tickpolicy='delay'/>
Aug 02 23:36:58 user nova-compute[72520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 02 23:36:58 user nova-compute[72520]:     <timer name='hpet' present='no'/>
Aug 02 23:36:58 user nova-compute[72520]:   </clock>
Aug 02 23:36:58 user nova-compute[72520]:   <on_poweroff>destroy</on_poweroff>
Aug 02 23:36:58 user nova-compute[72520]:   <on_reboot>restart</on_reboot>
Aug 02 23:36:58 user nova-compute[72520]:   <on_crash>destroy</on_crash>
Aug 02 23:36:58 user nova-compute[72520]:   <devices>
Aug 02 23:36:58 user nova-compute[72520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 02 23:36:58 user nova-compute[72520]:     <disk type='file' device='disk'>
Aug 02 23:36:58 user nova-compute[72520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 02 23:36:58 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk' index='2'/>
Aug 02 23:36:58 user nova-compute[72520]:       <backingStore type='file' index='3'>
Aug 02 23:36:58 user nova-compute[72520]:         <format type='raw'/>
Aug 02 23:36:58 user nova-compute[72520]:         <source file='/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab'/>
Aug 02 23:36:58 user nova-compute[72520]:         <backingStore/>
Aug 02 23:36:58 user nova-compute[72520]:       </backingStore>
Aug 02 23:36:58 user nova-compute[72520]:       <target dev='vda' bus='virtio'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='virtio-disk0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </disk>
Aug 02 23:36:58 user nova-compute[72520]:     <disk type='file' device='cdrom'>
Aug 02 23:36:58 user nova-compute[72520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 02 23:36:58 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config' index='1'/>
Aug 02 23:36:58 user nova-compute[72520]:       <backingStore/>
Aug 02 23:36:58 user nova-compute[72520]:       <target dev='hda' bus='ide'/>
Aug 02 23:36:58 user nova-compute[72520]:       <readonly/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='ide0-0-0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </disk>
Aug 02 23:36:58 user nova-compute[72520]:     <controller type='usb' index='0' model='none'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='usb'/>
Aug 02 23:36:58 user nova-compute[72520]:     </controller>
Aug 02 23:36:58 user nova-compute[72520]:     <controller type='pci' index='0' model='pci-root'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='pci.0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </controller>
Aug 02 23:36:58 user nova-compute[72520]:     <controller type='ide' index='0'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='ide'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 02 23:36:58 user nova-compute[72520]:     </controller>
Aug 02 23:36:58 user nova-compute[72520]:     <interface type='ethernet'>
Aug 02 23:36:58 user nova-compute[72520]:       <mac address='fa:16:3e:65:74:e4'/>
Aug 02 23:36:58 user nova-compute[72520]:       <target dev='tapdfa77141-b8'/>
Aug 02 23:36:58 user nova-compute[72520]:       <model type='virtio'/>
Aug 02 23:36:58 user nova-compute[72520]:       <mtu size='1442'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='net0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </interface>
Aug 02 23:36:58 user nova-compute[72520]:     <serial type='pty'>
Aug 02 23:36:58 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:58 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:58 user nova-compute[72520]:       <target type='isa-serial' port='0'>
Aug 02 23:36:58 user nova-compute[72520]:         <model name='isa-serial'/>
Aug 02 23:36:58 user nova-compute[72520]:       </target>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </serial>
Aug 02 23:36:58 user nova-compute[72520]:     <console type='pty' tty='/dev/pts/9'>
Aug 02 23:36:58 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:58 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:58 user nova-compute[72520]:       <target type='serial' port='0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </console>
Aug 02 23:36:58 user nova-compute[72520]:     <input type='mouse' bus='ps2'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='input0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </input>
Aug 02 23:36:58 user nova-compute[72520]:     <input type='keyboard' bus='ps2'>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='input1'/>
Aug 02 23:36:58 user nova-compute[72520]:     </input>
Aug 02 23:36:58 user nova-compute[72520]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 02 23:36:58 user nova-compute[72520]:       <listen type='address' address='0.0.0.0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </graphics>
Aug 02 23:36:58 user nova-compute[72520]:     <audio id='1' type='none'/>
Aug 02 23:36:58 user nova-compute[72520]:     <video>
Aug 02 23:36:58 user nova-compute[72520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='video0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </video>
Aug 02 23:36:58 user nova-compute[72520]:     <memballoon model='virtio'>
Aug 02 23:36:58 user nova-compute[72520]:       <stats period='10'/>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='balloon0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:58 user nova-compute[72520]:     <rng model='virtio'>
Aug 02 23:36:58 user nova-compute[72520]:       <backend model='random'>/dev/urandom</backend>
Aug 02 23:36:58 user nova-compute[72520]:       <alias name='rng0'/>
Aug 02 23:36:58 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 02 23:36:58 user nova-compute[72520]:     </rng>
Aug 02 23:36:58 user nova-compute[72520]:   </devices>
Aug 02 23:36:58 user nova-compute[72520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 02 23:36:58 user nova-compute[72520]:     <label>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</label>
Aug 02 23:36:58 user nova-compute[72520]:     <imagelabel>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</imagelabel>
Aug 02 23:36:58 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:58 user nova-compute[72520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 02 23:36:58 user nova-compute[72520]:     <label>+64055:+108</label>
Aug 02 23:36:58 user nova-compute[72520]:     <imagelabel>+64055:+108</imagelabel>
Aug 02 23:36:58 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:58 user nova-compute[72520]: </domain>
Aug 02 23:36:58 user nova-compute[72520]:  {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 02 23:36:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully detached device tap73bb1e41-be from instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 from the live domain config.
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converting VIF {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG os_vif [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73bb1e41-be, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:36:58 user nova-compute[72520]: INFO os_vif [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be')
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:58 user nova-compute[72520]:   <nova:package version="0.0.0"/>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:creationTime>2023-08-02 23:36:58</nova:creationTime>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:flavor name="m1.tiny">
Aug 02 23:36:58 user nova-compute[72520]:     <nova:memory>512</nova:memory>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:disk>1</nova:disk>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:swap>0</nova:swap>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:flavor>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:owner>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:owner>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:58 user nova-compute[72520]:   <nova:ports>
Aug 02 23:36:58 user nova-compute[72520]:     <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:36:58 user nova-compute[72520]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:36:58 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:58 user nova-compute[72520]:   </nova:ports>
Aug 02 23:36:58 user nova-compute[72520]: </nova:instance>
Aug 02 23:36:58 user nova-compute[72520]:  {{(pid=72520) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-7cb84711-ae57-4121-a510-687e1ee90f9f req-7ca61444-20e7-47c9-aeca-e29432d30199 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-unplugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7cb84711-ae57-4121-a510-687e1ee90f9f req-7ca61444-20e7-47c9-aeca-e29432d30199 service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7cb84711-ae57-4121-a510-687e1ee90f9f req-7ca61444-20e7-47c9-aeca-e29432d30199 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7cb84711-ae57-4121-a510-687e1ee90f9f req-7ca61444-20e7-47c9-aeca-e29432d30199 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:36:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-7cb84711-ae57-4121-a510-687e1ee90f9f req-7ca61444-20e7-47c9-aeca-e29432d30199 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-unplugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:36:58 user nova-compute[72520]: WARNING nova.compute.manager [req-7cb84711-ae57-4121-a510-687e1ee90f9f req-7ca61444-20e7-47c9-aeca-e29432d30199 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-unplugged-73bb1e41-bec9-4cea-bfce-563493c28c1c for instance with vm_state active and task_state None.
Aug 02 23:36:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-deleted-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:36:59 user nova-compute[72520]: INFO nova.compute.manager [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Neutron deleted interface 73bb1e41-bec9-4cea-bfce-563493c28c1c; detaching it from the instance and deleting it from the info cache
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.objects.instance [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Lazy-loading 'system_metadata' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquired lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.objects.instance [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Lazy-loading 'flavor' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019404.4156177, 00e60fe9-f01d-4b28-9870-a1c6a372d716 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:36:59 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] VM Stopped (Lifecycle Event)
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-71876945-425f-4746-b49c-df58913fc2c8 None None] [instance: 00e60fe9-f01d-4b28-9870-a1c6a372d716] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Converting VIF {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface> {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 02 23:36:59 user nova-compute[72520]:   <name>instance-0000000d</name>
Aug 02 23:36:59 user nova-compute[72520]:   <uuid>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</uuid>
Aug 02 23:36:59 user nova-compute[72520]:   <metadata>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:59 user nova-compute[72520]:   <nova:package version="0.0.0"/>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:creationTime>2023-08-02 23:36:58</nova:creationTime>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:flavor name="m1.tiny">
Aug 02 23:36:59 user nova-compute[72520]:     <nova:memory>512</nova:memory>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:disk>1</nova:disk>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:swap>0</nova:swap>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:flavor>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:owner>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:owner>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:ports>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:36:59 user nova-compute[72520]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:36:59 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:ports>
Aug 02 23:36:59 user nova-compute[72520]: </nova:instance>
Aug 02 23:36:59 user nova-compute[72520]:   </metadata>
Aug 02 23:36:59 user nova-compute[72520]:   <memory unit='KiB'>524288</memory>
Aug 02 23:36:59 user nova-compute[72520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 02 23:36:59 user nova-compute[72520]:   <vcpu placement='static'>1</vcpu>
Aug 02 23:36:59 user nova-compute[72520]:   <resource>
Aug 02 23:36:59 user nova-compute[72520]:     <partition>/machine</partition>
Aug 02 23:36:59 user nova-compute[72520]:   </resource>
Aug 02 23:36:59 user nova-compute[72520]:   <sysinfo type='smbios'>
Aug 02 23:36:59 user nova-compute[72520]:     <system>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='product'>OpenStack Nova</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='version'>0.0.0</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='serial'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='uuid'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='family'>Virtual Machine</entry>
Aug 02 23:36:59 user nova-compute[72520]:     </system>
Aug 02 23:36:59 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:59 user nova-compute[72520]:   <os>
Aug 02 23:36:59 user nova-compute[72520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 02 23:36:59 user nova-compute[72520]:     <boot dev='hd'/>
Aug 02 23:36:59 user nova-compute[72520]:     <smbios mode='sysinfo'/>
Aug 02 23:36:59 user nova-compute[72520]:   </os>
Aug 02 23:36:59 user nova-compute[72520]:   <features>
Aug 02 23:36:59 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:59 user nova-compute[72520]:     <apic/>
Aug 02 23:36:59 user nova-compute[72520]:     <vmcoreinfo state='on'/>
Aug 02 23:36:59 user nova-compute[72520]:   </features>
Aug 02 23:36:59 user nova-compute[72520]:   <cpu mode='custom' match='exact' check='full'>
Aug 02 23:36:59 user nova-compute[72520]:     <model fallback='forbid'>Nehalem</model>
Aug 02 23:36:59 user nova-compute[72520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 02 23:36:59 user nova-compute[72520]:     <feature policy='require' name='vme'/>
Aug 02 23:36:59 user nova-compute[72520]:     <feature policy='require' name='x2apic'/>
Aug 02 23:36:59 user nova-compute[72520]:     <feature policy='require' name='hypervisor'/>
Aug 02 23:36:59 user nova-compute[72520]:   </cpu>
Aug 02 23:36:59 user nova-compute[72520]:   <clock offset='utc'>
Aug 02 23:36:59 user nova-compute[72520]:     <timer name='pit' tickpolicy='delay'/>
Aug 02 23:36:59 user nova-compute[72520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 02 23:36:59 user nova-compute[72520]:     <timer name='hpet' present='no'/>
Aug 02 23:36:59 user nova-compute[72520]:   </clock>
Aug 02 23:36:59 user nova-compute[72520]:   <on_poweroff>destroy</on_poweroff>
Aug 02 23:36:59 user nova-compute[72520]:   <on_reboot>restart</on_reboot>
Aug 02 23:36:59 user nova-compute[72520]:   <on_crash>destroy</on_crash>
Aug 02 23:36:59 user nova-compute[72520]:   <devices>
Aug 02 23:36:59 user nova-compute[72520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 02 23:36:59 user nova-compute[72520]:     <disk type='file' device='disk'>
Aug 02 23:36:59 user nova-compute[72520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 02 23:36:59 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk' index='2'/>
Aug 02 23:36:59 user nova-compute[72520]:       <backingStore type='file' index='3'>
Aug 02 23:36:59 user nova-compute[72520]:         <format type='raw'/>
Aug 02 23:36:59 user nova-compute[72520]:         <source file='/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab'/>
Aug 02 23:36:59 user nova-compute[72520]:         <backingStore/>
Aug 02 23:36:59 user nova-compute[72520]:       </backingStore>
Aug 02 23:36:59 user nova-compute[72520]:       <target dev='vda' bus='virtio'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='virtio-disk0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </disk>
Aug 02 23:36:59 user nova-compute[72520]:     <disk type='file' device='cdrom'>
Aug 02 23:36:59 user nova-compute[72520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 02 23:36:59 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config' index='1'/>
Aug 02 23:36:59 user nova-compute[72520]:       <backingStore/>
Aug 02 23:36:59 user nova-compute[72520]:       <target dev='hda' bus='ide'/>
Aug 02 23:36:59 user nova-compute[72520]:       <readonly/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='ide0-0-0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </disk>
Aug 02 23:36:59 user nova-compute[72520]:     <controller type='usb' index='0' model='none'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='usb'/>
Aug 02 23:36:59 user nova-compute[72520]:     </controller>
Aug 02 23:36:59 user nova-compute[72520]:     <controller type='pci' index='0' model='pci-root'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='pci.0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </controller>
Aug 02 23:36:59 user nova-compute[72520]:     <controller type='ide' index='0'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='ide'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 02 23:36:59 user nova-compute[72520]:     </controller>
Aug 02 23:36:59 user nova-compute[72520]:     <interface type='ethernet'>
Aug 02 23:36:59 user nova-compute[72520]:       <mac address='fa:16:3e:65:74:e4'/>
Aug 02 23:36:59 user nova-compute[72520]:       <target dev='tapdfa77141-b8'/>
Aug 02 23:36:59 user nova-compute[72520]:       <model type='virtio'/>
Aug 02 23:36:59 user nova-compute[72520]:       <mtu size='1442'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='net0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </interface>
Aug 02 23:36:59 user nova-compute[72520]:     <serial type='pty'>
Aug 02 23:36:59 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:59 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:59 user nova-compute[72520]:       <target type='isa-serial' port='0'>
Aug 02 23:36:59 user nova-compute[72520]:         <model name='isa-serial'/>
Aug 02 23:36:59 user nova-compute[72520]:       </target>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </serial>
Aug 02 23:36:59 user nova-compute[72520]:     <console type='pty' tty='/dev/pts/9'>
Aug 02 23:36:59 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:59 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:59 user nova-compute[72520]:       <target type='serial' port='0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </console>
Aug 02 23:36:59 user nova-compute[72520]:     <input type='mouse' bus='ps2'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='input0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </input>
Aug 02 23:36:59 user nova-compute[72520]:     <input type='keyboard' bus='ps2'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='input1'/>
Aug 02 23:36:59 user nova-compute[72520]:     </input>
Aug 02 23:36:59 user nova-compute[72520]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 02 23:36:59 user nova-compute[72520]:       <listen type='address' address='0.0.0.0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </graphics>
Aug 02 23:36:59 user nova-compute[72520]:     <audio id='1' type='none'/>
Aug 02 23:36:59 user nova-compute[72520]:     <video>
Aug 02 23:36:59 user nova-compute[72520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='video0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </video>
Aug 02 23:36:59 user nova-compute[72520]:     <memballoon model='virtio'>
Aug 02 23:36:59 user nova-compute[72520]:       <stats period='10'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='balloon0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:59 user nova-compute[72520]:     <rng model='virtio'>
Aug 02 23:36:59 user nova-compute[72520]:       <backend model='random'>/dev/urandom</backend>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='rng0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </rng>
Aug 02 23:36:59 user nova-compute[72520]:   </devices>
Aug 02 23:36:59 user nova-compute[72520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 02 23:36:59 user nova-compute[72520]:     <label>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</label>
Aug 02 23:36:59 user nova-compute[72520]:     <imagelabel>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</imagelabel>
Aug 02 23:36:59 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:59 user nova-compute[72520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 02 23:36:59 user nova-compute[72520]:     <label>+64055:+108</label>
Aug 02 23:36:59 user nova-compute[72520]:     <imagelabel>+64055:+108</imagelabel>
Aug 02 23:36:59 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:59 user nova-compute[72520]: </domain>
Aug 02 23:36:59 user nova-compute[72520]:  {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface> {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:5d:2a"/><model type="virtio"/><mtu size="1442"/><target dev="tap73bb1e41-be"/></interface>not found in domain: <domain type='kvm' id='13'>
Aug 02 23:36:59 user nova-compute[72520]:   <name>instance-0000000d</name>
Aug 02 23:36:59 user nova-compute[72520]:   <uuid>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</uuid>
Aug 02 23:36:59 user nova-compute[72520]:   <metadata>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:59 user nova-compute[72520]:   <nova:package version="0.0.0"/>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:creationTime>2023-08-02 23:36:58</nova:creationTime>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:flavor name="m1.tiny">
Aug 02 23:36:59 user nova-compute[72520]:     <nova:memory>512</nova:memory>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:disk>1</nova:disk>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:swap>0</nova:swap>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:flavor>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:owner>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:owner>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:ports>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:36:59 user nova-compute[72520]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:36:59 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:ports>
Aug 02 23:36:59 user nova-compute[72520]: </nova:instance>
Aug 02 23:36:59 user nova-compute[72520]:   </metadata>
Aug 02 23:36:59 user nova-compute[72520]:   <memory unit='KiB'>524288</memory>
Aug 02 23:36:59 user nova-compute[72520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 02 23:36:59 user nova-compute[72520]:   <vcpu placement='static'>1</vcpu>
Aug 02 23:36:59 user nova-compute[72520]:   <resource>
Aug 02 23:36:59 user nova-compute[72520]:     <partition>/machine</partition>
Aug 02 23:36:59 user nova-compute[72520]:   </resource>
Aug 02 23:36:59 user nova-compute[72520]:   <sysinfo type='smbios'>
Aug 02 23:36:59 user nova-compute[72520]:     <system>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='product'>OpenStack Nova</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='version'>0.0.0</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='serial'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='uuid'>1c3580dd-23d0-4402-9a56-730e4c9f4bf8</entry>
Aug 02 23:36:59 user nova-compute[72520]:       <entry name='family'>Virtual Machine</entry>
Aug 02 23:36:59 user nova-compute[72520]:     </system>
Aug 02 23:36:59 user nova-compute[72520]:   </sysinfo>
Aug 02 23:36:59 user nova-compute[72520]:   <os>
Aug 02 23:36:59 user nova-compute[72520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 02 23:36:59 user nova-compute[72520]:     <boot dev='hd'/>
Aug 02 23:36:59 user nova-compute[72520]:     <smbios mode='sysinfo'/>
Aug 02 23:36:59 user nova-compute[72520]:   </os>
Aug 02 23:36:59 user nova-compute[72520]:   <features>
Aug 02 23:36:59 user nova-compute[72520]:     <acpi/>
Aug 02 23:36:59 user nova-compute[72520]:     <apic/>
Aug 02 23:36:59 user nova-compute[72520]:     <vmcoreinfo state='on'/>
Aug 02 23:36:59 user nova-compute[72520]:   </features>
Aug 02 23:36:59 user nova-compute[72520]:   <cpu mode='custom' match='exact' check='full'>
Aug 02 23:36:59 user nova-compute[72520]:     <model fallback='forbid'>Nehalem</model>
Aug 02 23:36:59 user nova-compute[72520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 02 23:36:59 user nova-compute[72520]:     <feature policy='require' name='vme'/>
Aug 02 23:36:59 user nova-compute[72520]:     <feature policy='require' name='x2apic'/>
Aug 02 23:36:59 user nova-compute[72520]:     <feature policy='require' name='hypervisor'/>
Aug 02 23:36:59 user nova-compute[72520]:   </cpu>
Aug 02 23:36:59 user nova-compute[72520]:   <clock offset='utc'>
Aug 02 23:36:59 user nova-compute[72520]:     <timer name='pit' tickpolicy='delay'/>
Aug 02 23:36:59 user nova-compute[72520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 02 23:36:59 user nova-compute[72520]:     <timer name='hpet' present='no'/>
Aug 02 23:36:59 user nova-compute[72520]:   </clock>
Aug 02 23:36:59 user nova-compute[72520]:   <on_poweroff>destroy</on_poweroff>
Aug 02 23:36:59 user nova-compute[72520]:   <on_reboot>restart</on_reboot>
Aug 02 23:36:59 user nova-compute[72520]:   <on_crash>destroy</on_crash>
Aug 02 23:36:59 user nova-compute[72520]:   <devices>
Aug 02 23:36:59 user nova-compute[72520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 02 23:36:59 user nova-compute[72520]:     <disk type='file' device='disk'>
Aug 02 23:36:59 user nova-compute[72520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 02 23:36:59 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk' index='2'/>
Aug 02 23:36:59 user nova-compute[72520]:       <backingStore type='file' index='3'>
Aug 02 23:36:59 user nova-compute[72520]:         <format type='raw'/>
Aug 02 23:36:59 user nova-compute[72520]:         <source file='/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab'/>
Aug 02 23:36:59 user nova-compute[72520]:         <backingStore/>
Aug 02 23:36:59 user nova-compute[72520]:       </backingStore>
Aug 02 23:36:59 user nova-compute[72520]:       <target dev='vda' bus='virtio'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='virtio-disk0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </disk>
Aug 02 23:36:59 user nova-compute[72520]:     <disk type='file' device='cdrom'>
Aug 02 23:36:59 user nova-compute[72520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 02 23:36:59 user nova-compute[72520]:       <source file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk.config' index='1'/>
Aug 02 23:36:59 user nova-compute[72520]:       <backingStore/>
Aug 02 23:36:59 user nova-compute[72520]:       <target dev='hda' bus='ide'/>
Aug 02 23:36:59 user nova-compute[72520]:       <readonly/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='ide0-0-0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </disk>
Aug 02 23:36:59 user nova-compute[72520]:     <controller type='usb' index='0' model='none'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='usb'/>
Aug 02 23:36:59 user nova-compute[72520]:     </controller>
Aug 02 23:36:59 user nova-compute[72520]:     <controller type='pci' index='0' model='pci-root'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='pci.0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </controller>
Aug 02 23:36:59 user nova-compute[72520]:     <controller type='ide' index='0'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='ide'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 02 23:36:59 user nova-compute[72520]:     </controller>
Aug 02 23:36:59 user nova-compute[72520]:     <interface type='ethernet'>
Aug 02 23:36:59 user nova-compute[72520]:       <mac address='fa:16:3e:65:74:e4'/>
Aug 02 23:36:59 user nova-compute[72520]:       <target dev='tapdfa77141-b8'/>
Aug 02 23:36:59 user nova-compute[72520]:       <model type='virtio'/>
Aug 02 23:36:59 user nova-compute[72520]:       <mtu size='1442'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='net0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </interface>
Aug 02 23:36:59 user nova-compute[72520]:     <serial type='pty'>
Aug 02 23:36:59 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:59 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:59 user nova-compute[72520]:       <target type='isa-serial' port='0'>
Aug 02 23:36:59 user nova-compute[72520]:         <model name='isa-serial'/>
Aug 02 23:36:59 user nova-compute[72520]:       </target>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </serial>
Aug 02 23:36:59 user nova-compute[72520]:     <console type='pty' tty='/dev/pts/9'>
Aug 02 23:36:59 user nova-compute[72520]:       <source path='/dev/pts/9'/>
Aug 02 23:36:59 user nova-compute[72520]:       <log file='/opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/console.log' append='off'/>
Aug 02 23:36:59 user nova-compute[72520]:       <target type='serial' port='0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='serial0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </console>
Aug 02 23:36:59 user nova-compute[72520]:     <input type='mouse' bus='ps2'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='input0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </input>
Aug 02 23:36:59 user nova-compute[72520]:     <input type='keyboard' bus='ps2'>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='input1'/>
Aug 02 23:36:59 user nova-compute[72520]:     </input>
Aug 02 23:36:59 user nova-compute[72520]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 02 23:36:59 user nova-compute[72520]:       <listen type='address' address='0.0.0.0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </graphics>
Aug 02 23:36:59 user nova-compute[72520]:     <audio id='1' type='none'/>
Aug 02 23:36:59 user nova-compute[72520]:     <video>
Aug 02 23:36:59 user nova-compute[72520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='video0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </video>
Aug 02 23:36:59 user nova-compute[72520]:     <memballoon model='virtio'>
Aug 02 23:36:59 user nova-compute[72520]:       <stats period='10'/>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='balloon0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </memballoon>
Aug 02 23:36:59 user nova-compute[72520]:     <rng model='virtio'>
Aug 02 23:36:59 user nova-compute[72520]:       <backend model='random'>/dev/urandom</backend>
Aug 02 23:36:59 user nova-compute[72520]:       <alias name='rng0'/>
Aug 02 23:36:59 user nova-compute[72520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 02 23:36:59 user nova-compute[72520]:     </rng>
Aug 02 23:36:59 user nova-compute[72520]:   </devices>
Aug 02 23:36:59 user nova-compute[72520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 02 23:36:59 user nova-compute[72520]:     <label>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</label>
Aug 02 23:36:59 user nova-compute[72520]:     <imagelabel>libvirt-1c3580dd-23d0-4402-9a56-730e4c9f4bf8</imagelabel>
Aug 02 23:36:59 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:59 user nova-compute[72520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 02 23:36:59 user nova-compute[72520]:     <label>+64055:+108</label>
Aug 02 23:36:59 user nova-compute[72520]:     <imagelabel>+64055:+108</imagelabel>
Aug 02 23:36:59 user nova-compute[72520]:   </seclabel>
Aug 02 23:36:59 user nova-compute[72520]: </domain>
Aug 02 23:36:59 user nova-compute[72520]:  {{(pid=72520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 02 23:36:59 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Detaching interface fa:16:3e:d9:5d:2a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap73bb1e41-be' not found.
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Converting VIF {"id": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "address": "fa:16:3e:d9:5d:2a", "network": {"id": "0610f2e7-49c8-4ca7-b92f-34f1fa889e04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1425540293", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb1e41-be", "ovs_interfaceid": "73bb1e41-bec9-4cea-bfce-563493c28c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG os_vif [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73bb1e41-be, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:36:59 user nova-compute[72520]: INFO os_vif [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=73bb1e41-bec9-4cea-bfce-563493c28c1c,network=Network(0610f2e7-49c8-4ca7-b92f-34f1fa889e04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb1e41-be')
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [req-210159c7-5a33-4d11-8966-5f1027cdda38 req-5d46aff6-1ede-452a-95e4-d26a45777a8d service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:36:59 user nova-compute[72520]:   <nova:package version="0.0.0"/>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:name>tempest-device-tagging-server-256875571</nova:name>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:creationTime>2023-08-02 23:36:59</nova:creationTime>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:flavor name="m1.tiny">
Aug 02 23:36:59 user nova-compute[72520]:     <nova:memory>512</nova:memory>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:disk>1</nova:disk>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:swap>0</nova:swap>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:vcpus>1</nova:vcpus>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:flavor>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:owner>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:user uuid="fbb520874684447d8894c00ae4f5359c">tempest-TaggedAttachmentsTest-1798656184-project-member</nova:user>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:project uuid="77f9e2d14a0b4abab0b07d282a808c77">tempest-TaggedAttachmentsTest-1798656184</nova:project>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:owner>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:36:59 user nova-compute[72520]:   <nova:ports>
Aug 02 23:36:59 user nova-compute[72520]:     <nova:port uuid="dfa77141-b84f-4751-9f42-f6678520df71">
Aug 02 23:36:59 user nova-compute[72520]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 02 23:36:59 user nova-compute[72520]:     </nova:port>
Aug 02 23:36:59 user nova-compute[72520]:   </nova:ports>
Aug 02 23:36:59 user nova-compute[72520]: </nova:instance>
Aug 02 23:36:59 user nova-compute[72520]:  {{(pid=72520) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Releasing lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:36:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-235d7906-3395-4f74-bc9b-9f984b1ffa5f tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "interface-1c3580dd-23d0-4402-9a56-730e4c9f4bf8-73bb1e41-bec9-4cea-bfce-563493c28c1c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.477s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-1409f8b1-0e8d-4023-af76-ff67514d52f8 req-6cc2c3a6-796d-4a26-af7c-51d50ec0b912 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1409f8b1-0e8d-4023-af76-ff67514d52f8 req-6cc2c3a6-796d-4a26-af7c-51d50ec0b912 service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1409f8b1-0e8d-4023-af76-ff67514d52f8 req-6cc2c3a6-796d-4a26-af7c-51d50ec0b912 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1409f8b1-0e8d-4023-af76-ff67514d52f8 req-6cc2c3a6-796d-4a26-af7c-51d50ec0b912 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-1409f8b1-0e8d-4023-af76-ff67514d52f8 req-6cc2c3a6-796d-4a26-af7c-51d50ec0b912 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:00 user nova-compute[72520]: WARNING nova.compute.manager [req-1409f8b1-0e8d-4023-af76-ff67514d52f8 req-6cc2c3a6-796d-4a26-af7c-51d50ec0b912 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-73bb1e41-bec9-4cea-bfce-563493c28c1c for instance with vm_state active and task_state None.
Aug 02 23:37:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:04 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019409.283054, b86f31d4-33c5-4b2b-a235-3b07b306f23a => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:37:04 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] VM Stopped (Lifecycle Event)
Aug 02 23:37:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e3747164-cf9b-4bb6-8b01-c3f4615eb118 None None] [instance: b86f31d4-33c5-4b2b-a235-3b07b306f23a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:11 user nova-compute[72520]: INFO nova.compute.manager [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Detaching volume 9331027c-5850-42c0-9dec-034ae18c058b
Aug 02 23:37:11 user nova-compute[72520]: INFO nova.virt.block_device [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attempting to driver detach volume 9331027c-5850-42c0-9dec-034ae18c058b from mountpoint /dev/vdb
Aug 02 23:37:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Attempting to detach device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:37:11 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:37:11 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:37:11 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:37:11 user nova-compute[72520]:   <serial>9331027c-5850-42c0-9dec-034ae18c058b</serial>
Aug 02 23:37:11 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:37:11 user nova-compute[72520]: </disk>
Aug 02 23:37:11 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:37:11 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config.
Aug 02 23:37:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:37:11 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:37:11 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:37:11 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:37:11 user nova-compute[72520]:   <serial>9331027c-5850-42c0-9dec-034ae18c058b</serial>
Aug 02 23:37:11 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:37:11 user nova-compute[72520]: </disk>
Aug 02 23:37:11 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:11 user nova-compute[72520]: INFO nova.compute.manager [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Terminating instance
Aug 02 23:37:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019432.1109107, f0f48878-9b8a-4078-8e7b-763b1331d037 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:37:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config.
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lhWPEugf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:37:12 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da8cdc3-a496-45ab-ab66-9c9a43a93ad7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[594be161-c632-477f-ac4c-b2715aa1d9c8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)
Aug 02 23:37:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b (non-flash)
Aug 02 23:37:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4298ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8677b6-7df3-4032-94b9-b033aac784cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c952a4de-9fb7-4c09-94ef-375a5706ba77]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84c27be-e57c-4e90-b316-a325269c8cdb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34485de6-ce6a-49c2-8528-67c8af804dbd]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-6222901a-9bd5-4d1d-b012-1ba1d885b5f7 req-4f06b14e-def1-40aa-9b0f-b80769ce41bb service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-vif-unplugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6222901a-9bd5-4d1d-b012-1ba1d885b5f7 req-4f06b14e-def1-40aa-9b0f-b80769ce41bb service nova] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6222901a-9bd5-4d1d-b012-1ba1d885b5f7 req-4f06b14e-def1-40aa-9b0f-b80769ce41bb service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6222901a-9bd5-4d1d-b012-1ba1d885b5f7 req-4f06b14e-def1-40aa-9b0f-b80769ce41bb service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-6222901a-9bd5-4d1d-b012-1ba1d885b5f7 req-4f06b14e-def1-40aa-9b0f-b80769ce41bb service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] No waiting events found dispatching network-vif-unplugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-6222901a-9bd5-4d1d-b012-1ba1d885b5f7 req-4f06b14e-def1-40aa-9b0f-b80769ce41bb service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-vif-unplugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fc3b19-80c0-4695-b294-d2894ec046ad]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[786d20f5-e85a-4176-b6db-ea569b15f603]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260]
Aug 02 23:37:12 user nova-compute[72520]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b, portal: 172.16.0.220,3260] successful.
Aug 02 23:37:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9331027c-5850-42c0-9dec-034ae18c058b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2316203a-8231-4d35-9d84-d105b1f1acb9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== disconnect_volume: return (285ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Instance destroyed successfully.
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lazy-loading 'resources' on Instance uuid a9fa9eda-ec05-4346-8694-89c2cd021663 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1114024249',display_name='tempest-VolumesAdminNegativeTest-server-1114024249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1114024249',id=4,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqVUCCYK/wDkQcqBvulgqVMjaKqev9tCSc/+yAuaXV7gzU+C0mzZE2kG5Snt4g9gH25LpMVRjlYufsKh7vaMswmfZJNMSWQSUSVfkeUwsjTxQ5E25vbpbTZk7/EG3Mzgg==',key_name='tempest-keypair-1441263731',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:31:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3748be8ace1d41ba8508d59f8f8373d8',ramdisk_id='',reservation_id='r-y36b5t0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-662521094',owner_user_name='tempest-VolumesAdminNegativeTest-662521094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc828569cbd645fab326233e841d2494',uuid=a9fa9eda-ec05-4346-8694-89c2cd021663,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converting VIF {"id": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "address": "fa:16:3e:e9:c5:49", "network": {"id": "932c453a-855e-48eb-8e54-3828dc3b6f36", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-483694110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3748be8ace1d41ba8508d59f8f8373d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f966658-57", "ovs_interfaceid": "5f966658-578f-4fc0-8158-a68b0b92b3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:49,bridge_name='br-int',has_traffic_filtering=True,id=5f966658-578f-4fc0-8158-a68b0b92b3f1,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f966658-57') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG os_vif [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:49,bridge_name='br-int',has_traffic_filtering=True,id=5f966658-578f-4fc0-8158-a68b0b92b3f1,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f966658-57') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f966658-57, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:37:12 user nova-compute[72520]: INFO os_vif [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:49,bridge_name='br-int',has_traffic_filtering=True,id=5f966658-578f-4fc0-8158-a68b0b92b3f1,network=Network(932c453a-855e-48eb-8e54-3828dc3b6f36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f966658-57')
Aug 02 23:37:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Deleting instance files /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663_del
Aug 02 23:37:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Deletion of /opt/stack/data/nova/instances/a9fa9eda-ec05-4346-8694-89c2cd021663_del complete
Aug 02 23:37:12 user nova-compute[72520]: INFO nova.compute.manager [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 02 23:37:12 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:37:12 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:37:13 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fefde421-f9f3-4162-8350-a2f4bee2aff3 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.675s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:13 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:13 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Took 0.98 seconds to deallocate network for instance.
Aug 02 23:37:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-9bcdb680-16a4-4a29-b71c-c3ddfa54dbc7 req-baf0217e-5687-41f5-b3d3-9acb027a1a73 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-vif-deleted-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:13 user nova-compute[72520]: INFO nova.compute.manager [req-9bcdb680-16a4-4a29-b71c-c3ddfa54dbc7 req-baf0217e-5687-41f5-b3d3-9acb027a1a73 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Neutron deleted interface 5f966658-578f-4fc0-8158-a68b0b92b3f1; detaching it from the instance and deleting it from the info cache
Aug 02 23:37:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-9bcdb680-16a4-4a29-b71c-c3ddfa54dbc7 req-baf0217e-5687-41f5-b3d3-9acb027a1a73 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-9bcdb680-16a4-4a29-b71c-c3ddfa54dbc7 req-baf0217e-5687-41f5-b3d3-9acb027a1a73 service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Detach interface failed, port_id=5f966658-578f-4fc0-8158-a68b0b92b3f1, reason: Instance a9fa9eda-ec05-4346-8694-89c2cd021663 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:37:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.606s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-08e9f15d-7b86-45b0-ab9b-147da6c1630b req-6fa0b816-15b7-4bdc-baa8-afa075b54b5d service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received event network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08e9f15d-7b86-45b0-ab9b-147da6c1630b req-6fa0b816-15b7-4bdc-baa8-afa075b54b5d service nova] Acquiring lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08e9f15d-7b86-45b0-ab9b-147da6c1630b req-6fa0b816-15b7-4bdc-baa8-afa075b54b5d service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08e9f15d-7b86-45b0-ab9b-147da6c1630b req-6fa0b816-15b7-4bdc-baa8-afa075b54b5d service nova] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-08e9f15d-7b86-45b0-ab9b-147da6c1630b req-6fa0b816-15b7-4bdc-baa8-afa075b54b5d service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] No waiting events found dispatching network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:14 user nova-compute[72520]: WARNING nova.compute.manager [req-08e9f15d-7b86-45b0-ab9b-147da6c1630b req-6fa0b816-15b7-4bdc-baa8-afa075b54b5d service nova] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Received unexpected event network-vif-plugged-5f966658-578f-4fc0-8158-a68b0b92b3f1 for instance with vm_state deleted and task_state None.
Aug 02 23:37:14 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Deleted allocations for instance a9fa9eda-ec05-4346-8694-89c2cd021663
Aug 02 23:37:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f9669a28-441e-4e96-837e-a89efd81ca61 tempest-VolumesAdminNegativeTest-662521094 tempest-VolumesAdminNegativeTest-662521094-project-member] Lock "a9fa9eda-ec05-4346-8694-89c2cd021663" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.696s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 8e524afb-4d71-43a5-8b91-4f558c409237 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid da91726a-77ee-4d02-b6eb-a95389edc413 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 0e13bfd1-68d9-442a-b95b-40caaa10586c {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "8e524afb-4d71-43a5-8b91-4f558c409237" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "da91726a-77ee-4d02-b6eb-a95389edc413" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "23931909-81f4-44fb-b936-10a27c16febb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "8e524afb-4d71-43a5-8b91-4f558c409237" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "23931909-81f4-44fb-b936-10a27c16febb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "da91726a-77ee-4d02-b6eb-a95389edc413" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:27 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019432.6444466, a9fa9eda-ec05-4346-8694-89c2cd021663 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:37:27 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] VM Stopped (Lifecycle Event)
Aug 02 23:37:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d177b53a-6349-442b-88d6-a040e3a3e9b6 None None] [instance: a9fa9eda-ec05-4346-8694-89c2cd021663] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:31 user nova-compute[72520]: INFO nova.compute.manager [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Unshelving
Aug 02 23:37:32 user nova-compute[72520]: INFO nova.virt.block_device [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Booting with volume 4202cc7f-a6ab-461f-80fd-4ca68d1d418a at /dev/vda
Aug 02 23:37:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efbd6ae-ec4f-4fbc-87cf-2a896c09ab44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff71c443-e967-4908-ab43-54f6350a170f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b9c9c3-bde3-4527-aa13-69d6463879cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2390e-4343-4436-a797-5213338461e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:37:32 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:37:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaf283d-8718-4a76-9076-95327ec5bbc8]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating existing volume attachment record: ef4b64ab-db08-4123-b4a0-2c0d64a8ccef {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:37:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "8e524afb-4d71-43a5-8b91-4f558c409237" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:34 user nova-compute[72520]: INFO nova.compute.manager [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Terminating instance
Aug 02 23:37:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-8ae0002a-e7a8-4a71-8c4b-5eedd0f920d5 req-737d3aad-6116-41eb-a694-9c95c4b3c6b8 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-vif-unplugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8ae0002a-e7a8-4a71-8c4b-5eedd0f920d5 req-737d3aad-6116-41eb-a694-9c95c4b3c6b8 service nova] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8ae0002a-e7a8-4a71-8c4b-5eedd0f920d5 req-737d3aad-6116-41eb-a694-9c95c4b3c6b8 service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8ae0002a-e7a8-4a71-8c4b-5eedd0f920d5 req-737d3aad-6116-41eb-a694-9c95c4b3c6b8 service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-8ae0002a-e7a8-4a71-8c4b-5eedd0f920d5 req-737d3aad-6116-41eb-a694-9c95c4b3c6b8 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] No waiting events found dispatching network-vif-unplugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-8ae0002a-e7a8-4a71-8c4b-5eedd0f920d5 req-737d3aad-6116-41eb-a694-9c95c4b3c6b8 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-vif-unplugged-471151f5-ee67-41d0-817b-333804b86f4e for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:37:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Instance destroyed successfully.
Aug 02 23:37:35 user nova-compute[72520]: DEBUG nova.objects.instance [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lazy-loading 'resources' on Instance uuid 8e524afb-4d71-43a5-8b91-4f558c409237 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1733465889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1733465889',id=2,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0t+OeQQsd8/MJGIHmipXsYdugLJQSS1iMQuOWBrl53/qFJZdeb5ydCeFR6arx2NqgbYXH7/Y48dE0GONPrBbaJO2xYXfg3lZw8SNk78hERAHbdfDHS37OYAipuqzsMOw==',key_name='tempest-keypair-1655150030',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75a3862c26eb4331b72c545cf91e3802',ramdisk_id='',reservation_id='r-r1hdvk0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1063891997',owner_user_name='tempest-ServerActionsV293TestJSON-1063891997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:31:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c16da763da24854b7921b9e9d6fe59e',uuid=8e524afb-4d71-43a5-8b91-4f558c409237,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converting VIF {"id": "471151f5-ee67-41d0-817b-333804b86f4e", "address": "fa:16:3e:71:ac:fd", "network": {"id": "d4265ab1-5296-4515-9192-f59b27cc80e3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1515312093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75a3862c26eb4331b72c545cf91e3802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471151f5-ee", "ovs_interfaceid": "471151f5-ee67-41d0-817b-333804b86f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=471151f5-ee67-41d0-817b-333804b86f4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471151f5-ee') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG os_vif [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=471151f5-ee67-41d0-817b-333804b86f4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471151f5-ee') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471151f5-ee, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:35 user nova-compute[72520]: INFO os_vif [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=471151f5-ee67-41d0-817b-333804b86f4e,network=Network(d4265ab1-5296-4515-9192-f59b27cc80e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471151f5-ee')
Aug 02 23:37:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Deleting instance files /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237_del
Aug 02 23:37:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Deletion of /opt/stack/data/nova/instances/8e524afb-4d71-43a5-8b91-4f558c409237_del complete
Aug 02 23:37:35 user nova-compute[72520]: INFO nova.compute.manager [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 02 23:37:35 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:37:35 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:36 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Took 0.99 seconds to deallocate network for instance.
Aug 02 23:37:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-bc084765-6d43-4979-8639-766443267c82 req-876a0a14-f5d3-4bef-83ac-32825e6d0af4 service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-vif-deleted-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:36 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Deleted allocations for instance 8e524afb-4d71-43a5-8b91-4f558c409237
Aug 02 23:37:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-5a836ab4-0c00-4389-824d-8890abc334a2 req-2a048b1d-285d-475b-9b62-b518a0e2659d service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received event network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a836ab4-0c00-4389-824d-8890abc334a2 req-2a048b1d-285d-475b-9b62-b518a0e2659d service nova] Acquiring lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a836ab4-0c00-4389-824d-8890abc334a2 req-2a048b1d-285d-475b-9b62-b518a0e2659d service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a836ab4-0c00-4389-824d-8890abc334a2 req-2a048b1d-285d-475b-9b62-b518a0e2659d service nova] Lock "8e524afb-4d71-43a5-8b91-4f558c409237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-5a836ab4-0c00-4389-824d-8890abc334a2 req-2a048b1d-285d-475b-9b62-b518a0e2659d service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] No waiting events found dispatching network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:36 user nova-compute[72520]: WARNING nova.compute.manager [req-5a836ab4-0c00-4389-824d-8890abc334a2 req-2a048b1d-285d-475b-9b62-b518a0e2659d service nova] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Received unexpected event network-vif-plugged-471151f5-ee67-41d0-817b-333804b86f4e for instance with vm_state deleted and task_state None.
Aug 02 23:37:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4ede3e08-29ac-4531-9852-b546f92074e1 tempest-ServerActionsV293TestJSON-1063891997 tempest-ServerActionsV293TestJSON-1063891997-project-member] Lock "8e524afb-4d71-43a5-8b91-4f558c409237" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'pci_requests' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'numa_topology' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:37:39 user nova-compute[72520]: INFO nova.compute.claims [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Claim successful on node user
Aug 02 23:37:40 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:40 user nova-compute[72520]: INFO nova.network.neutron [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing instance network info cache due to event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:37:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:37:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Creating image(s)
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Ensure instance console log exists: /opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Start _get_guest_xml network_info=[{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a425b6aa-bb98-4b02-8263-571f8e1707c9', 'attached_at': '', 'detached_at': '', 'volume_id': '4202cc7f-a6ab-461f-80fd-4ca68d1d418a', 'serial': '4202cc7f-a6ab-461f-80fd-4ca68d1d418a'}, 'attachment_id': 'ef4b64ab-db08-4123-b4a0-2c0d64a8ccef', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:37:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:37:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.objects.instance [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'vcpu_model' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:37:41 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:37:41 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:37:41 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[724e711b-0aca-4e5b-944a-576e0ba767b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:37:41 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec5de5-476b-4d0f-8855-9ced58f79e8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a] added
Aug 02 23:37:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9b739e-2995-44f1-bacc-64fa50c21223]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b308b7-e893-42cb-a31c-1f6c6da79bf8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsqTradz {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsqTradz" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda25ef3-72d4-4c8c-b607-8ac765210ab1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nsqTradz'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ead67f-a2ed-40b1-89aa-f9f5a7e10ae6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdc7026-9da3-44aa-a05e-0ab674ceab37]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:37:41 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:37:41 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:37:41 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 02 23:37:41 user nova-compute[72520]: 
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e5185e-8704-4930-84fe-d48b9b8d3a35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]
Aug 02 23:37:41 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.
Aug 02 23:37:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae6eb2-9947-4250-87cc-e65dece73bcc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a1f82b-4a71-486f-8b01-fd719e6c324e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:37:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:37:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e89d5d-43f2-449d-9e0f-179021195bf3]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updated VIF entry in instance network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1df32b9f-1479-4cd9-a80b-99554bf083a0 req-d39448f9-0ffd-4c56-8607-8dca0021361a service nova] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:37:42 user nova-compute[72520]: INFO nova.compute.claims [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Claim successful on node user
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23637303865383366', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637303865383366', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-522014739',display_name='tempest-TestShelveInstance-server-522014739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-522014739',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-283917505',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccfc4fa5c29a48dc9021bbd09b4668f1',ramdisk_id='',reservation_id='r-i23tzsg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-171572139',owner_user_name='tempest-TestShelveInstance-171572139-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:37:32Z,user_data=None,user_id='a7420cb0556144b99ef811558ca21e17',uuid=a425b6aa-bb98-4b02-8263-571f8e1707c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converting VIF {"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'pci_devices' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:37:42 user nova-compute[72520]:   <uuid>a425b6aa-bb98-4b02-8263-571f8e1707c9</uuid>
Aug 02 23:37:42 user nova-compute[72520]:   <name>instance-0000000b</name>
Aug 02 23:37:42 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:37:42 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:37:42 user nova-compute[72520]:   <metadata>
Aug 02 23:37:42 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:37:42 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:37:42 user nova-compute[72520]:       <nova:name>tempest-TestShelveInstance-server-522014739</nova:name>
Aug 02 23:37:42 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:37:41</nova:creationTime>
Aug 02 23:37:42 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:37:42 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:37:42 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:37:42 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:37:42 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:37:42 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:37:42 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:37:42 user nova-compute[72520]:       <nova:owner>
Aug 02 23:37:42 user nova-compute[72520]:         <nova:user uuid="a7420cb0556144b99ef811558ca21e17">tempest-TestShelveInstance-171572139-project-member</nova:user>
Aug 02 23:37:42 user nova-compute[72520]:         <nova:project uuid="ccfc4fa5c29a48dc9021bbd09b4668f1">tempest-TestShelveInstance-171572139</nova:project>
Aug 02 23:37:42 user nova-compute[72520]:       </nova:owner>
Aug 02 23:37:42 user nova-compute[72520]:       <nova:ports>
Aug 02 23:37:42 user nova-compute[72520]:         <nova:port uuid="af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1">
Aug 02 23:37:42 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 02 23:37:42 user nova-compute[72520]:         </nova:port>
Aug 02 23:37:42 user nova-compute[72520]:       </nova:ports>
Aug 02 23:37:42 user nova-compute[72520]:     </nova:instance>
Aug 02 23:37:42 user nova-compute[72520]:   </metadata>
Aug 02 23:37:42 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:37:42 user nova-compute[72520]:     <system>
Aug 02 23:37:42 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:37:42 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:37:42 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:37:42 user nova-compute[72520]:       <entry name="serial">a425b6aa-bb98-4b02-8263-571f8e1707c9</entry>
Aug 02 23:37:42 user nova-compute[72520]:       <entry name="uuid">a425b6aa-bb98-4b02-8263-571f8e1707c9</entry>
Aug 02 23:37:42 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:37:42 user nova-compute[72520]:     </system>
Aug 02 23:37:42 user nova-compute[72520]:   </sysinfo>
Aug 02 23:37:42 user nova-compute[72520]:   <os>
Aug 02 23:37:42 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:37:42 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:37:42 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:37:42 user nova-compute[72520]:   </os>
Aug 02 23:37:42 user nova-compute[72520]:   <features>
Aug 02 23:37:42 user nova-compute[72520]:     <acpi/>
Aug 02 23:37:42 user nova-compute[72520]:     <apic/>
Aug 02 23:37:42 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:37:42 user nova-compute[72520]:   </features>
Aug 02 23:37:42 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:37:42 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:37:42 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:37:42 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:37:42 user nova-compute[72520]:   </clock>
Aug 02 23:37:42 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:37:42 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:37:42 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:37:42 user nova-compute[72520]:   </cpu>
Aug 02 23:37:42 user nova-compute[72520]:   <devices>
Aug 02 23:37:42 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:37:42 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:37:42 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 02 23:37:42 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:37:42 user nova-compute[72520]:       <serial>4202cc7f-a6ab-461f-80fd-4ca68d1d418a</serial>
Aug 02 23:37:42 user nova-compute[72520]:     </disk>
Aug 02 23:37:42 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:37:42 user nova-compute[72520]:       <mac address="fa:16:3e:7a:74:7b"/>
Aug 02 23:37:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:37:42 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:37:42 user nova-compute[72520]:       <target dev="tapaf7b293b-0a"/>
Aug 02 23:37:42 user nova-compute[72520]:     </interface>
Aug 02 23:37:42 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:37:42 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9/console.log" append="off"/>
Aug 02 23:37:42 user nova-compute[72520]:     </serial>
Aug 02 23:37:42 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:37:42 user nova-compute[72520]:     <video>
Aug 02 23:37:42 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:37:42 user nova-compute[72520]:     </video>
Aug 02 23:37:42 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:37:42 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:37:42 user nova-compute[72520]:     </rng>
Aug 02 23:37:42 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:37:42 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:37:42 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:37:42 user nova-compute[72520]:     </memballoon>
Aug 02 23:37:42 user nova-compute[72520]:   </devices>
Aug 02 23:37:42 user nova-compute[72520]: </domain>
Aug 02 23:37:42 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-522014739',display_name='tempest-TestShelveInstance-server-522014739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-522014739',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-283917505',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccfc4fa5c29a48dc9021bbd09b4668f1',ramdisk_id='',reservation_id='r-i23tzsg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-171572139',owner_user_name='tempest-TestShelveInstance-171572139-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:37:32Z,user_data=None,user_id='a7420cb0556144b99ef811558ca21e17',uuid=a425b6aa-bb98-4b02-8263-571f8e1707c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converting VIF {"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG os_vif [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:37:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf7b293b-0a, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf7b293b-0a, col_values=(('external_ids', {'iface-id': 'af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:74:7b', 'vm-uuid': 'a425b6aa-bb98-4b02-8263-571f8e1707c9'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:42 user nova-compute[72520]: INFO os_vif [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a')
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] No VIF found with MAC fa:16:3e:7a:74:7b, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.policy [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9f79446d734cbfa7644b128bbf5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052da981a9a4629b46fb0d3533c96c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:37:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Creating image(s)
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "/opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [{"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-1c3580dd-23d0-4402-9a56-730e4c9f4bf8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.129s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk 1073741824" returned: 0 in 0.048s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Cannot resize image /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.objects.instance [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'migration_context' on Instance uuid a07ce9ad-eb58-428f-9db8-6c9c5ce02878 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Ensure instance console log exists: /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Successfully created port: 1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-480dea28-ac75-44bb-89c9-c06cdfdf38ff req-28b3d0e4-3883-4883-92d0-6be9f8a82517 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-480dea28-ac75-44bb-89c9-c06cdfdf38ff req-28b3d0e4-3883-4883-92d0-6be9f8a82517 service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-480dea28-ac75-44bb-89c9-c06cdfdf38ff req-28b3d0e4-3883-4883-92d0-6be9f8a82517 service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-480dea28-ac75-44bb-89c9-c06cdfdf38ff req-28b3d0e4-3883-4883-92d0-6be9f8a82517 service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-480dea28-ac75-44bb-89c9-c06cdfdf38ff req-28b3d0e4-3883-4883-92d0-6be9f8a82517 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:44 user nova-compute[72520]: WARNING nova.compute.manager [req-480dea28-ac75-44bb-89c9-c06cdfdf38ff req-28b3d0e4-3883-4883-92d0-6be9f8a82517 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received unexpected event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 02 23:37:44 user nova-compute[72520]: DEBUG nova.network.neutron [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Successfully updated port: 1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquired lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG nova.network.neutron [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:37:44 user nova-compute[72520]: DEBUG nova.network.neutron [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.network.neutron [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Updating instance_info_cache with network_info: [{"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Releasing lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Instance network_info: |[{"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Start _get_guest_xml network_info=[{"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:37:45 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:37:45 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1035952291',display_name='tempest-AttachVolumeNegativeTest-server-1035952291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1035952291',id=19,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1R3DFquA1flNJkdxQ3YEXG9ibQJmUNAF5RwuywlL61/yJjDf7i6YuDfLPIfIZ2BbYzgHT0gA4H6DUvEndrsrj4lP6CLzyWBsiJZhSEiZhqfYzS3zE0iWzAkQ4ZWCrJzQ==',key_name='tempest-keypair-355210541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-nq0oieoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=a07ce9ad-eb58-428f-9db8-6c9c5ce02878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ef5e1ef-779d-40f6-b581-25edb92d48c0,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef5e1ef-77') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.objects.instance [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'pci_devices' on Instance uuid a07ce9ad-eb58-428f-9db8-6c9c5ce02878 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:37:45 user nova-compute[72520]:   <uuid>a07ce9ad-eb58-428f-9db8-6c9c5ce02878</uuid>
Aug 02 23:37:45 user nova-compute[72520]:   <name>instance-00000013</name>
Aug 02 23:37:45 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:37:45 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:37:45 user nova-compute[72520]:   <metadata>
Aug 02 23:37:45 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:37:45 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:37:45 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1035952291</nova:name>
Aug 02 23:37:45 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:37:45</nova:creationTime>
Aug 02 23:37:45 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:37:45 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:37:45 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:37:45 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:37:45 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:37:45 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:37:45 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:37:45 user nova-compute[72520]:       <nova:owner>
Aug 02 23:37:45 user nova-compute[72520]:         <nova:user uuid="eb9f79446d734cbfa7644b128bbf5275">tempest-AttachVolumeNegativeTest-1376380752-project-member</nova:user>
Aug 02 23:37:45 user nova-compute[72520]:         <nova:project uuid="9052da981a9a4629b46fb0d3533c96c7">tempest-AttachVolumeNegativeTest-1376380752</nova:project>
Aug 02 23:37:45 user nova-compute[72520]:       </nova:owner>
Aug 02 23:37:45 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:37:45 user nova-compute[72520]:       <nova:ports>
Aug 02 23:37:45 user nova-compute[72520]:         <nova:port uuid="1ef5e1ef-779d-40f6-b581-25edb92d48c0">
Aug 02 23:37:45 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 02 23:37:45 user nova-compute[72520]:         </nova:port>
Aug 02 23:37:45 user nova-compute[72520]:       </nova:ports>
Aug 02 23:37:45 user nova-compute[72520]:     </nova:instance>
Aug 02 23:37:45 user nova-compute[72520]:   </metadata>
Aug 02 23:37:45 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:37:45 user nova-compute[72520]:     <system>
Aug 02 23:37:45 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:37:45 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:37:45 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:37:45 user nova-compute[72520]:       <entry name="serial">a07ce9ad-eb58-428f-9db8-6c9c5ce02878</entry>
Aug 02 23:37:45 user nova-compute[72520]:       <entry name="uuid">a07ce9ad-eb58-428f-9db8-6c9c5ce02878</entry>
Aug 02 23:37:45 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:37:45 user nova-compute[72520]:     </system>
Aug 02 23:37:45 user nova-compute[72520]:   </sysinfo>
Aug 02 23:37:45 user nova-compute[72520]:   <os>
Aug 02 23:37:45 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:37:45 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:37:45 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:37:45 user nova-compute[72520]:   </os>
Aug 02 23:37:45 user nova-compute[72520]:   <features>
Aug 02 23:37:45 user nova-compute[72520]:     <acpi/>
Aug 02 23:37:45 user nova-compute[72520]:     <apic/>
Aug 02 23:37:45 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:37:45 user nova-compute[72520]:   </features>
Aug 02 23:37:45 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:37:45 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:37:45 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:37:45 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:37:45 user nova-compute[72520]:   </clock>
Aug 02 23:37:45 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:37:45 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:37:45 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:37:45 user nova-compute[72520]:   </cpu>
Aug 02 23:37:45 user nova-compute[72520]:   <devices>
Aug 02 23:37:45 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:37:45 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:37:45 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk"/>
Aug 02 23:37:45 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:37:45 user nova-compute[72520]:     </disk>
Aug 02 23:37:45 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:37:45 user nova-compute[72520]:       <mac address="fa:16:3e:ea:a9:ee"/>
Aug 02 23:37:45 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:37:45 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:37:45 user nova-compute[72520]:       <target dev="tap1ef5e1ef-77"/>
Aug 02 23:37:45 user nova-compute[72520]:     </interface>
Aug 02 23:37:45 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:37:45 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/console.log" append="off"/>
Aug 02 23:37:45 user nova-compute[72520]:     </serial>
Aug 02 23:37:45 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:37:45 user nova-compute[72520]:     <video>
Aug 02 23:37:45 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:37:45 user nova-compute[72520]:     </video>
Aug 02 23:37:45 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:37:45 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:37:45 user nova-compute[72520]:     </rng>
Aug 02 23:37:45 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:37:45 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:37:45 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:37:45 user nova-compute[72520]:     </memballoon>
Aug 02 23:37:45 user nova-compute[72520]:   </devices>
Aug 02 23:37:45 user nova-compute[72520]: </domain>
Aug 02 23:37:45 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1035952291',display_name='tempest-AttachVolumeNegativeTest-server-1035952291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1035952291',id=19,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1R3DFquA1flNJkdxQ3YEXG9ibQJmUNAF5RwuywlL61/yJjDf7i6YuDfLPIfIZ2BbYzgHT0gA4H6DUvEndrsrj4lP6CLzyWBsiJZhSEiZhqfYzS3zE0iWzAkQ4ZWCrJzQ==',key_name='tempest-keypair-355210541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-nq0oieoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=a07ce9ad-eb58-428f-9db8-6c9c5ce02878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ef5e1ef-779d-40f6-b581-25edb92d48c0,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef5e1ef-77') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG os_vif [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ef5e1ef-779d-40f6-b581-25edb92d48c0,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef5e1ef-77') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ef5e1ef-77, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ef5e1ef-77, col_values=(('external_ids', {'iface-id': '1ef5e1ef-779d-40f6-b581-25edb92d48c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a9:ee', 'vm-uuid': 'a07ce9ad-eb58-428f-9db8-6c9c5ce02878'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:45 user nova-compute[72520]: INFO os_vif [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ef5e1ef-779d-40f6-b581-25edb92d48c0,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef5e1ef-77')
Aug 02 23:37:45 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:37:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No VIF found with MAC fa:16:3e:ea:a9:ee, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019466.1303723, a425b6aa-bb98-4b02-8263-571f8e1707c9 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:37:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] VM Resumed (Lifecycle Event)
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance spawned successfully.
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:37:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019466.1331854, a425b6aa-bb98-4b02-8263-571f8e1707c9 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:37:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] VM Started (Lifecycle Event)
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:37:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:37:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-72d9c834-0e43-41a9-8981-c5aa8cb5081d tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.240s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-changed-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Refreshing instance network info cache due to event network-changed-1ef5e1ef-779d-40f6-b581-25edb92d48c0. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] Acquiring lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] Acquired lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.network.neutron [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Refreshing network info cache for port 1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.network.neutron [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Updated VIF entry in instance network info cache for port 1ef5e1ef-779d-40f6-b581-25edb92d48c0. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.network.neutron [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Updating instance_info_cache with network_info: [{"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] Releasing lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:46 user nova-compute[72520]: WARNING nova.compute.manager [req-ef5e7da5-eb64-4663-bddf-668a87c3849e req-5c497678-f1ba-4fbe-a345-da43fc903b26 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received unexpected event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with vm_state active and task_state None.
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-8a523ac2-eed6-4d7b-be11-c2da2b474939 req-ab96e613-abda-4d0e-8d96-fccefc7e9cde service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8a523ac2-eed6-4d7b-be11-c2da2b474939 req-ab96e613-abda-4d0e-8d96-fccefc7e9cde service nova] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8a523ac2-eed6-4d7b-be11-c2da2b474939 req-ab96e613-abda-4d0e-8d96-fccefc7e9cde service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8a523ac2-eed6-4d7b-be11-c2da2b474939 req-ab96e613-abda-4d0e-8d96-fccefc7e9cde service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-8a523ac2-eed6-4d7b-be11-c2da2b474939 req-ab96e613-abda-4d0e-8d96-fccefc7e9cde service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] No waiting events found dispatching network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:47 user nova-compute[72520]: WARNING nova.compute.manager [req-8a523ac2-eed6-4d7b-be11-c2da2b474939 req-ab96e613-abda-4d0e-8d96-fccefc7e9cde service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received unexpected event network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 for instance with vm_state building and task_state spawning.
Aug 02 23:37:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019468.853901, a07ce9ad-eb58-428f-9db8-6c9c5ce02878 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:37:48 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] VM Resumed (Lifecycle Event)
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:37:48 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Instance spawned successfully.
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:37:48 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019468.8653913, a07ce9ad-eb58-428f-9db8-6c9c5ce02878 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:37:48 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] VM Started (Lifecycle Event)
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:48 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:37:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:49 user nova-compute[72520]: INFO nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 02 23:37:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:49 user nova-compute[72520]: INFO nova.compute.manager [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Took 6.81 seconds to build instance.
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-93645e63-d7db-4c28-8b56-6b5e73af30f7 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.939s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:49 user nova-compute[72520]: INFO nova.compute.manager [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Terminating instance
Aug 02 23:37:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-b44c4d52-599d-47fc-8c02-91c345785051 req-0c433559-3429-40a1-9417-fccaaa1e205d service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b44c4d52-599d-47fc-8c02-91c345785051 req-0c433559-3429-40a1-9417-fccaaa1e205d service nova] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b44c4d52-599d-47fc-8c02-91c345785051 req-0c433559-3429-40a1-9417-fccaaa1e205d service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b44c4d52-599d-47fc-8c02-91c345785051 req-0c433559-3429-40a1-9417-fccaaa1e205d service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-b44c4d52-599d-47fc-8c02-91c345785051 req-0c433559-3429-40a1-9417-fccaaa1e205d service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] No waiting events found dispatching network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:49 user nova-compute[72520]: WARNING nova.compute.manager [req-b44c4d52-599d-47fc-8c02-91c345785051 req-0c433559-3429-40a1-9417-fccaaa1e205d service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received unexpected event network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 for instance with vm_state active and task_state None.
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-a96bccdf-fd84-438f-837b-f75b4dd8e2de req-55dd23ce-54f0-456f-bcd4-a2b438f862e5 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-unplugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a96bccdf-fd84-438f-837b-f75b4dd8e2de req-55dd23ce-54f0-456f-bcd4-a2b438f862e5 service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a96bccdf-fd84-438f-837b-f75b4dd8e2de req-55dd23ce-54f0-456f-bcd4-a2b438f862e5 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a96bccdf-fd84-438f-837b-f75b4dd8e2de req-55dd23ce-54f0-456f-bcd4-a2b438f862e5 service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-a96bccdf-fd84-438f-837b-f75b4dd8e2de req-55dd23ce-54f0-456f-bcd4-a2b438f862e5 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-unplugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-a96bccdf-fd84-438f-837b-f75b4dd8e2de req-55dd23ce-54f0-456f-bcd4-a2b438f862e5 service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-unplugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:37:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:37:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=25.68640899658203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:50 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Instance destroyed successfully.
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lazy-loading 'resources' on Instance uuid 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-02T23:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256875571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-256875571',id=13,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3G3QZO0fbqxJVuuexwJxOKJuofd+1UV6EB9ygQ8tlGo58ktlNv3fnHqmVtNxOFWM4m3PRxIH1b+ZdCdN6UcwrSmw/awu61MndX/onFMUjEK1ep07eBf7qDLAiGOiwCYw==',key_name='tempest-keypair-1684550221',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77f9e2d14a0b4abab0b07d282a808c77',ramdisk_id='',reservation_id='r-e04qdeop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1798656184',owner_user_name='tempest-TaggedAttachmentsTest-1798656184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb520874684447d8894c00ae4f5359c',uuid=1c3580dd-23d0-4402-9a56-730e4c9f4bf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converting VIF {"id": "dfa77141-b84f-4751-9f42-f6678520df71", "address": "fa:16:3e:65:74:e4", "network": {"id": "524c81bf-0097-4ccd-a55e-4c5ef4d4a16f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1195106067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77f9e2d14a0b4abab0b07d282a808c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa77141-b8", "ovs_interfaceid": "dfa77141-b84f-4751-9f42-f6678520df71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:74:e4,bridge_name='br-int',has_traffic_filtering=True,id=dfa77141-b84f-4751-9f42-f6678520df71,network=Network(524c81bf-0097-4ccd-a55e-4c5ef4d4a16f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa77141-b8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG os_vif [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:74:e4,bridge_name='br-int',has_traffic_filtering=True,id=dfa77141-b84f-4751-9f42-f6678520df71,network=Network(524c81bf-0097-4ccd-a55e-4c5ef4d4a16f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa77141-b8') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfa77141-b8, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:37:50 user nova-compute[72520]: INFO os_vif [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:74:e4,bridge_name='br-int',has_traffic_filtering=True,id=dfa77141-b84f-4751-9f42-f6678520df71,network=Network(524c81bf-0097-4ccd-a55e-4c5ef4d4a16f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa77141-b8')
Aug 02 23:37:50 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Deleting instance files /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8_del
Aug 02 23:37:50 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Deletion of /opt/stack/data/nova/instances/1c3580dd-23d0-4402-9a56-730e4c9f4bf8_del complete
Aug 02 23:37:50 user nova-compute[72520]: INFO nova.compute.manager [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 02 23:37:50 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019455.3817003, 8e524afb-4d71-43a5-8b91-4f558c409237 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:37:50 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] VM Stopped (Lifecycle Event)
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-dc482b6d-19b0-4da4-bc32-33cfcd52209c None None] [instance: 8e524afb-4d71-43a5-8b91-4f558c409237] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance da91726a-77ee-4d02-b6eb-a95389edc413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a425b6aa-bb98-4b02-8263-571f8e1707c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:51 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Took 0.97 seconds to deallocate network for instance.
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-bd6fde63-3721-4f50-ae29-7e2deb4458a9 req-26f0bc13-3bdc-4662-862c-c20ebfce4bbc service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-deleted-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:51 user nova-compute[72520]: INFO nova.compute.manager [req-bd6fde63-3721-4f50-ae29-7e2deb4458a9 req-26f0bc13-3bdc-4662-862c-c20ebfce4bbc service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Neutron deleted interface dfa77141-b84f-4751-9f42-f6678520df71; detaching it from the instance and deleting it from the info cache
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-bd6fde63-3721-4f50-ae29-7e2deb4458a9 req-26f0bc13-3bdc-4662-862c-c20ebfce4bbc service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-bd6fde63-3721-4f50-ae29-7e2deb4458a9 req-26f0bc13-3bdc-4662-862c-c20ebfce4bbc service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Detach interface failed, port_id=dfa77141-b84f-4751-9f42-f6678520df71, reason: Instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:51 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Deleted allocations for instance 1c3580dd-23d0-4402-9a56-730e4c9f4bf8
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3e70a534-2ab7-4829-bb9f-9fe0da9e9fab tempest-TaggedAttachmentsTest-1798656184 tempest-TaggedAttachmentsTest-1798656184-project-member] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:51 user nova-compute[72520]: WARNING nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with vm_state deleted and task_state None.
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:51 user nova-compute[72520]: WARNING nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with vm_state deleted and task_state None.
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:51 user nova-compute[72520]: WARNING nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with vm_state deleted and task_state None.
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-unplugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-unplugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:51 user nova-compute[72520]: WARNING nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-unplugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with vm_state deleted and task_state None.
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Acquiring lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] Lock "1c3580dd-23d0-4402-9a56-730e4c9f4bf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:37:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] No waiting events found dispatching network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:37:51 user nova-compute[72520]: WARNING nova.compute.manager [req-e2a1419c-3a78-4954-b6eb-fe59de1c5522 req-90e7fcc1-b971-4d8d-b8c9-cfd10da5a68b service nova] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Received unexpected event network-vif-plugged-dfa77141-b84f-4751-9f42-f6678520df71 for instance with vm_state deleted and task_state None.
Aug 02 23:37:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:37:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:37:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:37:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:38:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:38:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:38:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:38:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:38:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:04 user nova-compute[72520]: INFO nova.compute.manager [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attaching volume b07a80d9-60e5-4e68-be18-d7ddc234f545 to /dev/vdb
Aug 02 23:38:04 user nova-compute[72520]: DEBUG os_brick.utils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c6dac-7d7e-41eb-81a4-d769b1b0a58d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388a84e-909c-4b6b-bcc9-dca2dca22985]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ac5046-962f-4461-acc7-97e6faf23c4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb9591-93f1-4b8d-9f5f-a5960261fbae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:38:05 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:38:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe4d579-ca53-41f0-bd19-e7587d2fe829]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG os_brick.utils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating existing volume attachment record: fe82a55a-a98a-4675-b6ea-f7c0b19a91fa {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019470.0284772, 1c3580dd-23d0-4402-9a56-730e4c9f4bf8 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:05 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] VM Stopped (Lifecycle Event)
Aug 02 23:38:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-dfb207f6-d44d-44c8-b62a-31c35e634c15 None None] [instance: 1c3580dd-23d0-4402-9a56-730e4c9f4bf8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnaEiqgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:38:12 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:38:12 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:38:12 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce8c1bc-6b03-4ef8-a3da-ee9dfc2caa36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:38:12 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a55b12f-85a5-4c10-bd21-492ee4039a36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545] added
Aug 02 23:38:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[159732a9-4d19-461a-8186-8a6e52d6e344]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "da91726a-77ee-4d02-b6eb-a95389edc413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:12 user nova-compute[72520]: INFO nova.compute.manager [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Terminating instance
Aug 02 23:38:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c98f2a-ec19-4d55-9e28-1446b74f4a6f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnaEiqgG {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnaEiqgG" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3de8d8b-61f2-4c34-a224-efcb900a653e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnaEiqgG'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1228a48a-0c11-4dc8-8c3b-4878ba146122]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[62184d48-f555-410f-9047-80a428a9dede]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:38:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:38:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69de27-b82e-41ed-a2b5-9dca3f4a9cb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260]
Aug 02 23:38:12 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260] successful.
Aug 02 23:38:12 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bebcb4-0966-443c-9e6f-6d10df72aec7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdda43e-be98-49ce-920c-f6e9cf6fa8c0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:38:13 user nova-compute[72520]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 (non-flash)
Aug 02 23:38:13 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:38:13 user nova-compute[72520]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 (non-flash)
Aug 02 23:38:13 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[22345f66-9ef9-434a-bec4-65dd09d0ab51]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnaEiqgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-480e5b74-d762-422c-a58a-7ef83b615f2b req-fd4227f5-752e-406c-80da-5a28012722ab service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received event network-vif-unplugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-480e5b74-d762-422c-a58a-7ef83b615f2b req-fd4227f5-752e-406c-80da-5a28012722ab service nova] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-480e5b74-d762-422c-a58a-7ef83b615f2b req-fd4227f5-752e-406c-80da-5a28012722ab service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-480e5b74-d762-422c-a58a-7ef83b615f2b req-fd4227f5-752e-406c-80da-5a28012722ab service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-480e5b74-d762-422c-a58a-7ef83b615f2b req-fd4227f5-752e-406c-80da-5a28012722ab service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] No waiting events found dispatching network-vif-unplugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-480e5b74-d762-422c-a58a-7ef83b615f2b req-fd4227f5-752e-406c-80da-5a28012722ab service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received event network-vif-unplugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:38:13 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Instance destroyed successfully.
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lazy-loading 'resources' on Instance uuid da91726a-77ee-4d02-b6eb-a95389edc413 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-776953486',display_name='tempest-VolumesNegativeTest-instance-776953486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-776953486',id=15,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:36:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='486a2f0c16c04ebba565665cae279a6d',ramdisk_id='',reservation_id='r-a6ukf9l5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1564259388',owner_user_name='tempest-VolumesNegativeTest-1564259388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:36:32Z,user_data=None,user_id='0eb2a1daad5c4ca1a08a05a96f35abe4',uuid=da91726a-77ee-4d02-b6eb-a95389edc413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Converting VIF {"id": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "address": "fa:16:3e:27:5e:38", "network": {"id": "2172d0fb-86c9-415a-810b-4078de26c0ea", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9cf09fb1019e43f589f82d1ed506d2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b96bf2-5b", "ovs_interfaceid": "c5b96bf2-5b6c-4a00-98a6-b0f08198651f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:5e:38,bridge_name='br-int',has_traffic_filtering=True,id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f,network=Network(2172d0fb-86c9-415a-810b-4078de26c0ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b96bf2-5b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG os_vif [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:5e:38,bridge_name='br-int',has_traffic_filtering=True,id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f,network=Network(2172d0fb-86c9-415a-810b-4078de26c0ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b96bf2-5b') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5b96bf2-5b, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:38:13 user nova-compute[72520]: INFO os_vif [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:5e:38,bridge_name='br-int',has_traffic_filtering=True,id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f,network=Network(2172d0fb-86c9-415a-810b-4078de26c0ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b96bf2-5b')
Aug 02 23:38:13 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Deleting instance files /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413_del
Aug 02 23:38:13 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Deletion of /opt/stack/data/nova/instances/da91726a-77ee-4d02-b6eb-a95389edc413_del complete
Aug 02 23:38:13 user nova-compute[72520]: INFO nova.compute.manager [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 02 23:38:13 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:13 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Took 0.47 seconds to deallocate network for instance.
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-c3ce21c3-f008-418f-a378-e75805579b60 req-71d41392-7da8-444a-bc9d-87b5f8e42249 service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received event network-vif-deleted-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:13 user nova-compute[72520]: INFO nova.compute.manager [req-c3ce21c3-f008-418f-a378-e75805579b60 req-71d41392-7da8-444a-bc9d-87b5f8e42249 service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Neutron deleted interface c5b96bf2-5b6c-4a00-98a6-b0f08198651f; detaching it from the instance and deleting it from the info cache
Aug 02 23:38:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-c3ce21c3-f008-418f-a378-e75805579b60 req-71d41392-7da8-444a-bc9d-87b5f8e42249 service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-c3ce21c3-f008-418f-a378-e75805579b60 req-71d41392-7da8-444a-bc9d-87b5f8e42249 service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Detach interface failed, port_id=c5b96bf2-5b6c-4a00-98a6-b0f08198651f, reason: Instance da91726a-77ee-4d02-b6eb-a95389edc413 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23731323266303531', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731323266303531', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:38:14 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:38:14 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:38:14 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:38:14 user nova-compute[72520]:   <serial>b07a80d9-60e5-4e68-be18-d7ddc234f545</serial>
Aug 02 23:38:14 user nova-compute[72520]: </disk>
Aug 02 23:38:14 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:14 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Deleted allocations for instance da91726a-77ee-4d02-b6eb-a95389edc413
Aug 02 23:38:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f55bfb14-0835-481f-9f72-81a8ed45d547 tempest-VolumesNegativeTest-1564259388 tempest-VolumesNegativeTest-1564259388-project-member] Lock "da91726a-77ee-4d02-b6eb-a95389edc413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.604s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No VIF found with MAC fa:16:3e:98:7d:b0, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:38:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c26cfdf5-d944-41ae-a1c2-9fe9ef63c546 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.712s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-c7ea6ffa-5b53-4450-85bc-4129149f4650 req-a7c94dd3-9fbe-4222-980d-6768dd5f0f8b service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received event network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c7ea6ffa-5b53-4450-85bc-4129149f4650 req-a7c94dd3-9fbe-4222-980d-6768dd5f0f8b service nova] Acquiring lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c7ea6ffa-5b53-4450-85bc-4129149f4650 req-a7c94dd3-9fbe-4222-980d-6768dd5f0f8b service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c7ea6ffa-5b53-4450-85bc-4129149f4650 req-a7c94dd3-9fbe-4222-980d-6768dd5f0f8b service nova] Lock "da91726a-77ee-4d02-b6eb-a95389edc413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-c7ea6ffa-5b53-4450-85bc-4129149f4650 req-a7c94dd3-9fbe-4222-980d-6768dd5f0f8b service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] No waiting events found dispatching network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:15 user nova-compute[72520]: WARNING nova.compute.manager [req-c7ea6ffa-5b53-4450-85bc-4129149f4650 req-a7c94dd3-9fbe-4222-980d-6768dd5f0f8b service nova] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Received unexpected event network-vif-plugged-c5b96bf2-5b6c-4a00-98a6-b0f08198651f for instance with vm_state deleted and task_state None.
Aug 02 23:38:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:17 user nova-compute[72520]: INFO nova.compute.manager [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Detaching volume b07a80d9-60e5-4e68-be18-d7ddc234f545
Aug 02 23:38:17 user nova-compute[72520]: INFO nova.virt.block_device [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attempting to driver detach volume b07a80d9-60e5-4e68-be18-d7ddc234f545 from mountpoint /dev/vdb
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Attempting to detach device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:38:17 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:38:17 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:38:17 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:38:17 user nova-compute[72520]:   <serial>b07a80d9-60e5-4e68-be18-d7ddc234f545</serial>
Aug 02 23:38:17 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:38:17 user nova-compute[72520]: </disk>
Aug 02 23:38:17 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:38:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config.
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:38:17 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:38:17 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:38:17 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:38:17 user nova-compute[72520]:   <serial>b07a80d9-60e5-4e68-be18-d7ddc234f545</serial>
Aug 02 23:38:17 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:38:17 user nova-compute[72520]: </disk>
Aug 02 23:38:17 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019497.6607907, f0f48878-9b8a-4078-8e7b-763b1331d037 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:38:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config.
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnaEiqgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:38:17 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1e3b7f-d69e-4363-92ad-e5032c666031]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd94d8d-6b4a-490d-8e54-1b8162d01832]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:38:17 user nova-compute[72520]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 (non-flash)
Aug 02 23:38:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:38:17 user nova-compute[72520]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 (non-flash)
Aug 02 23:38:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc2c2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36ff298-e044-464d-b8a2-6fd0755e59ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71ba77e-6d88-4bbb-9149-2c223640567a]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3cf8e2-ce0c-49c2-9d76-ff01da05a1fd]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6f0b82-997f-46c1-8ee7-aaaa77ab165f]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0090a74f-2d61-4353-a011-d16613014963]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746224b-409f-4003-86f2-ce29d25b3083]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260]
Aug 02 23:38:17 user nova-compute[72520]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545, portal: 172.16.0.220,3260] successful.
Aug 02 23:38:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07a80d9-60e5-4e68-be18-d7ddc234f545 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0241a93-677f-422d-8e2e-421f2f56aee3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== disconnect_volume: return (276ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:38:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:38:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-43c4aa56-030e-49a5-8dc3-a95e5b33c56d tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:38:20 user nova-compute[72520]: INFO nova.compute.claims [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Claim successful on node user
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:38:20 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:38:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.policy [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4848df27d404a9eb33ec7e7dd45dd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f50f35e2b7466ea2a922b0525b2fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:38:21 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Creating image(s)
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.127s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk 1073741824" returned: 0 in 0.048s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:21 user nova-compute[72520]: INFO nova.compute.manager [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Rescuing
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Successfully created port: ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Cannot resize image /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'migration_context' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Ensure instance console log exists: /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updating instance_info_cache with network_info: [{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-de5a63d8-1e9b-44e7-bbfc-421da342a14d req-fba81df3-c316-4a77-a3dd-ead6551212b5 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-unplugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de5a63d8-1e9b-44e7-bbfc-421da342a14d req-fba81df3-c316-4a77-a3dd-ead6551212b5 service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de5a63d8-1e9b-44e7-bbfc-421da342a14d req-fba81df3-c316-4a77-a3dd-ead6551212b5 service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de5a63d8-1e9b-44e7-bbfc-421da342a14d req-fba81df3-c316-4a77-a3dd-ead6551212b5 service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-de5a63d8-1e9b-44e7-bbfc-421da342a14d req-fba81df3-c316-4a77-a3dd-ead6551212b5 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-unplugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:22 user nova-compute[72520]: WARNING nova.compute.manager [req-de5a63d8-1e9b-44e7-bbfc-421da342a14d req-fba81df3-c316-4a77-a3dd-ead6551212b5 service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received unexpected event network-vif-unplugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with vm_state active and task_state rescuing.
Aug 02 23:38:22 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance destroyed successfully.
Aug 02 23:38:22 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Attempting rescue
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 02 23:38:22 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Creating image(s)
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'trusted_certs' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Successfully updated port: ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquired lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue" returned: 0 in 0.056s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'migration_context' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Start _get_guest_xml network_info=[{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:a2:15:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'resources' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'numa_topology' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:22 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:22 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:38:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1365006288',display_name='tempest-ServerRescueNegativeTestJSON-server-1365006288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1365006288',id=17,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:36:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-xocj6gh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:41Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=23931909-81f4-44fb-b936-10a27c16febb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:a2:15:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:a2:15:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'pci_devices' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:38:23 user nova-compute[72520]:   <uuid>23931909-81f4-44fb-b936-10a27c16febb</uuid>
Aug 02 23:38:23 user nova-compute[72520]:   <name>instance-00000011</name>
Aug 02 23:38:23 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:38:23 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:38:23 user nova-compute[72520]:   <metadata>
Aug 02 23:38:23 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:38:23 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1365006288</nova:name>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:38:22</nova:creationTime>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:38:23 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:38:23 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:owner>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:user uuid="d02269696a0d47738d8daa53d44b3b70">tempest-ServerRescueNegativeTestJSON-1442912244-project-member</nova:user>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:project uuid="cb887059a9634cce9f17319a980a18f4">tempest-ServerRescueNegativeTestJSON-1442912244</nova:project>
Aug 02 23:38:23 user nova-compute[72520]:       </nova:owner>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:ports>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:port uuid="1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72">
Aug 02 23:38:23 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 02 23:38:23 user nova-compute[72520]:         </nova:port>
Aug 02 23:38:23 user nova-compute[72520]:       </nova:ports>
Aug 02 23:38:23 user nova-compute[72520]:     </nova:instance>
Aug 02 23:38:23 user nova-compute[72520]:   </metadata>
Aug 02 23:38:23 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:38:23 user nova-compute[72520]:     <system>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="serial">23931909-81f4-44fb-b936-10a27c16febb</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="uuid">23931909-81f4-44fb-b936-10a27c16febb</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:38:23 user nova-compute[72520]:     </system>
Aug 02 23:38:23 user nova-compute[72520]:   </sysinfo>
Aug 02 23:38:23 user nova-compute[72520]:   <os>
Aug 02 23:38:23 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:38:23 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:38:23 user nova-compute[72520]:   </os>
Aug 02 23:38:23 user nova-compute[72520]:   <features>
Aug 02 23:38:23 user nova-compute[72520]:     <acpi/>
Aug 02 23:38:23 user nova-compute[72520]:     <apic/>
Aug 02 23:38:23 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:38:23 user nova-compute[72520]:   </features>
Aug 02 23:38:23 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:38:23 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:38:23 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:38:23 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:38:23 user nova-compute[72520]:   </clock>
Aug 02 23:38:23 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:38:23 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:38:23 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:38:23 user nova-compute[72520]:   </cpu>
Aug 02 23:38:23 user nova-compute[72520]:   <devices>
Aug 02 23:38:23 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:38:23 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:38:23 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue"/>
Aug 02 23:38:23 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:38:23 user nova-compute[72520]:     </disk>
Aug 02 23:38:23 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:38:23 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:38:23 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk"/>
Aug 02 23:38:23 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:38:23 user nova-compute[72520]:     </disk>
Aug 02 23:38:23 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:38:23 user nova-compute[72520]:       <mac address="fa:16:3e:a2:15:80"/>
Aug 02 23:38:23 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:38:23 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:38:23 user nova-compute[72520]:       <target dev="tap1a9d8d42-40"/>
Aug 02 23:38:23 user nova-compute[72520]:     </interface>
Aug 02 23:38:23 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:38:23 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/console.log" append="off"/>
Aug 02 23:38:23 user nova-compute[72520]:     </serial>
Aug 02 23:38:23 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:38:23 user nova-compute[72520]:     <video>
Aug 02 23:38:23 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:38:23 user nova-compute[72520]:     </video>
Aug 02 23:38:23 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:38:23 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:38:23 user nova-compute[72520]:     </rng>
Aug 02 23:38:23 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:38:23 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:38:23 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:38:23 user nova-compute[72520]:     </memballoon>
Aug 02 23:38:23 user nova-compute[72520]:   </devices>
Aug 02 23:38:23 user nova-compute[72520]: </domain>
Aug 02 23:38:23 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:38:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance destroyed successfully.
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No VIF found with MAC fa:16:3e:a2:15:80, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Releasing lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance network_info: |[{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Start _get_guest_xml network_info=[{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:38:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1926157642',display_name='tempest-ServerActionsTestOtherA-server-1926157642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1926157642',id=20,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-8ioinyiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=6ca3c320-bf1c-43b5-973c-4d73b22487ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:38:23 user nova-compute[72520]:   <uuid>6ca3c320-bf1c-43b5-973c-4d73b22487ac</uuid>
Aug 02 23:38:23 user nova-compute[72520]:   <name>instance-00000014</name>
Aug 02 23:38:23 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:38:23 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:38:23 user nova-compute[72520]:   <metadata>
Aug 02 23:38:23 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:38:23 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:name>tempest-ServerActionsTestOtherA-server-1926157642</nova:name>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:38:23</nova:creationTime>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:38:23 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:38:23 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:owner>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:user uuid="e4848df27d404a9eb33ec7e7dd45dd12">tempest-ServerActionsTestOtherA-102203488-project-member</nova:user>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:project uuid="c2f50f35e2b7466ea2a922b0525b2fb1">tempest-ServerActionsTestOtherA-102203488</nova:project>
Aug 02 23:38:23 user nova-compute[72520]:       </nova:owner>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:38:23 user nova-compute[72520]:       <nova:ports>
Aug 02 23:38:23 user nova-compute[72520]:         <nova:port uuid="ad1bea50-6df7-41da-b7db-48366aeb40b3">
Aug 02 23:38:23 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 02 23:38:23 user nova-compute[72520]:         </nova:port>
Aug 02 23:38:23 user nova-compute[72520]:       </nova:ports>
Aug 02 23:38:23 user nova-compute[72520]:     </nova:instance>
Aug 02 23:38:23 user nova-compute[72520]:   </metadata>
Aug 02 23:38:23 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:38:23 user nova-compute[72520]:     <system>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="serial">6ca3c320-bf1c-43b5-973c-4d73b22487ac</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="uuid">6ca3c320-bf1c-43b5-973c-4d73b22487ac</entry>
Aug 02 23:38:23 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:38:23 user nova-compute[72520]:     </system>
Aug 02 23:38:23 user nova-compute[72520]:   </sysinfo>
Aug 02 23:38:23 user nova-compute[72520]:   <os>
Aug 02 23:38:23 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:38:23 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:38:23 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:38:23 user nova-compute[72520]:   </os>
Aug 02 23:38:23 user nova-compute[72520]:   <features>
Aug 02 23:38:23 user nova-compute[72520]:     <acpi/>
Aug 02 23:38:23 user nova-compute[72520]:     <apic/>
Aug 02 23:38:23 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:38:23 user nova-compute[72520]:   </features>
Aug 02 23:38:23 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:38:23 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:38:23 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:38:23 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:38:23 user nova-compute[72520]:   </clock>
Aug 02 23:38:23 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:38:23 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:38:23 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:38:23 user nova-compute[72520]:   </cpu>
Aug 02 23:38:23 user nova-compute[72520]:   <devices>
Aug 02 23:38:23 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:38:23 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:38:23 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk"/>
Aug 02 23:38:23 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:38:23 user nova-compute[72520]:     </disk>
Aug 02 23:38:23 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:38:23 user nova-compute[72520]:       <mac address="fa:16:3e:4a:23:f6"/>
Aug 02 23:38:23 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:38:23 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:38:23 user nova-compute[72520]:       <target dev="tapad1bea50-6d"/>
Aug 02 23:38:23 user nova-compute[72520]:     </interface>
Aug 02 23:38:23 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:38:23 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/console.log" append="off"/>
Aug 02 23:38:23 user nova-compute[72520]:     </serial>
Aug 02 23:38:23 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:38:23 user nova-compute[72520]:     <video>
Aug 02 23:38:23 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:38:23 user nova-compute[72520]:     </video>
Aug 02 23:38:23 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:38:23 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:38:23 user nova-compute[72520]:     </rng>
Aug 02 23:38:23 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:38:23 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:38:23 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:38:23 user nova-compute[72520]:     </memballoon>
Aug 02 23:38:23 user nova-compute[72520]:   </devices>
Aug 02 23:38:23 user nova-compute[72520]: </domain>
Aug 02 23:38:23 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1926157642',display_name='tempest-ServerActionsTestOtherA-server-1926157642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1926157642',id=20,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-8ioinyiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=6ca3c320-bf1c-43b5-973c-4d73b22487ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG os_vif [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad1bea50-6d, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad1bea50-6d, col_values=(('external_ids', {'iface-id': 'ad1bea50-6df7-41da-b7db-48366aeb40b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:23:f6', 'vm-uuid': '6ca3c320-bf1c-43b5-973c-4d73b22487ac'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:23 user nova-compute[72520]: INFO os_vif [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d')
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No VIF found with MAC fa:16:3e:4a:23:f6, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:38:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:24 user nova-compute[72520]: WARNING nova.compute.manager [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received unexpected event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with vm_state active and task_state rescuing.
Aug 02 23:38:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-changed-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Refreshing instance network info cache due to event network-changed-ad1bea50-6df7-41da-b7db-48366aeb40b3. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] Acquiring lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] Acquired lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Refreshing network info cache for port ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updated VIF entry in instance network info cache for port ad1bea50-6df7-41da-b7db-48366aeb40b3. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddb00e4a-688a-4a7f-94ce-7ccd0a6b871d req-a4ddcbf0-6feb-4843-9eed-72bcebd71a0f service nova] Releasing lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-5b20cd74-5ba8-4861-8ca2-21fcd288c728 req-c2e89dfe-4a06-4ca2-9e03-0ef65a63f9bc service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5b20cd74-5ba8-4861-8ca2-21fcd288c728 req-c2e89dfe-4a06-4ca2-9e03-0ef65a63f9bc service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5b20cd74-5ba8-4861-8ca2-21fcd288c728 req-c2e89dfe-4a06-4ca2-9e03-0ef65a63f9bc service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5b20cd74-5ba8-4861-8ca2-21fcd288c728 req-c2e89dfe-4a06-4ca2-9e03-0ef65a63f9bc service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-5b20cd74-5ba8-4861-8ca2-21fcd288c728 req-c2e89dfe-4a06-4ca2-9e03-0ef65a63f9bc service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:25 user nova-compute[72520]: WARNING nova.compute.manager [req-5b20cd74-5ba8-4861-8ca2-21fcd288c728 req-c2e89dfe-4a06-4ca2-9e03-0ef65a63f9bc service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received unexpected event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with vm_state building and task_state spawning.
Aug 02 23:38:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:26 user nova-compute[72520]: WARNING nova.compute.manager [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received unexpected event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with vm_state active and task_state rescuing.
Aug 02 23:38:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:26 user nova-compute[72520]: WARNING nova.compute.manager [req-54929445-215a-486d-b75e-cfd0c946de9a req-494c9190-3777-4715-a433-fc626f2aad1d service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received unexpected event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with vm_state active and task_state rescuing.
Aug 02 23:38:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-b593b415-9c23-4458-b8e5-e30e40847564 req-059c6bc7-fec3-40d5-bd00-3f2c401506ae service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b593b415-9c23-4458-b8e5-e30e40847564 req-059c6bc7-fec3-40d5-bd00-3f2c401506ae service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b593b415-9c23-4458-b8e5-e30e40847564 req-059c6bc7-fec3-40d5-bd00-3f2c401506ae service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b593b415-9c23-4458-b8e5-e30e40847564 req-059c6bc7-fec3-40d5-bd00-3f2c401506ae service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-b593b415-9c23-4458-b8e5-e30e40847564 req-059c6bc7-fec3-40d5-bd00-3f2c401506ae service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:27 user nova-compute[72520]: WARNING nova.compute.manager [req-b593b415-9c23-4458-b8e5-e30e40847564 req-059c6bc7-fec3-40d5-bd00-3f2c401506ae service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received unexpected event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with vm_state building and task_state spawning.
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019508.040178, 6ca3c320-bf1c-43b5-973c-4d73b22487ac => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] VM Resumed (Lifecycle Event)
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-2dd91332-36bf-4f64-900e-10e0a20e649f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance spawned successfully.
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019508.0506244, 6ca3c320-bf1c-43b5-973c-4d73b22487ac => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] VM Started (Lifecycle Event)
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for 23931909-81f4-44fb-b936-10a27c16febb due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019508.06286, 23931909-81f4-44fb-b936-10a27c16febb => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] VM Resumed (Lifecycle Event)
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Took 7.12 seconds to spawn the instance on the hypervisor.
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019508.0648534, 23931909-81f4-44fb-b936-10a27c16febb => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] VM Started (Lifecycle Event)
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Took 7.76 seconds to build instance.
Aug 02 23:38:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5aec2dae-8f5e-4d4c-a1ce-ba607bc9334f tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.855s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019493.361324, da91726a-77ee-4d02-b6eb-a95389edc413 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:28 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] VM Stopped (Lifecycle Event)
Aug 02 23:38:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b0bd897c-4107-4cd6-99bd-1f3c7954c208 None None] [instance: da91726a-77ee-4d02-b6eb-a95389edc413] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:29 user nova-compute[72520]: INFO nova.compute.manager [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] instance snapshotting
Aug 02 23:38:29 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Beginning live snapshot process
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.159s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8hyk6xqn/9f80785c47894ba1812c9c4e34a1481e.delta 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8hyk6xqn/9f80785c47894ba1812c9c4e34a1481e.delta 1073741824" returned: 0 in 0.052s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 02 23:38:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] COPY block job progress, current cursor: 2424832 final cursor: 75497472 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:38:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:38:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 02 23:38:32 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:38:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8hyk6xqn/9f80785c47894ba1812c9c4e34a1481e.delta /opt/stack/data/nova/instances/snapshots/tmp8hyk6xqn/9f80785c47894ba1812c9c4e34a1481e {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8hyk6xqn/9f80785c47894ba1812c9c4e34a1481e.delta /opt/stack/data/nova/instances/snapshots/tmp8hyk6xqn/9f80785c47894ba1812c9c4e34a1481e" returned: 0 in 0.497s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:32 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Snapshot extracted, beginning image upload
Aug 02 23:38:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Snapshot image upload complete
Aug 02 23:38:35 user nova-compute[72520]: INFO nova.compute.manager [None req-8fc34921-0e34-411e-a328-397609c671a7 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Took 5.34 seconds to snapshot the instance on the hypervisor.
Aug 02 23:38:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:38:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:38:40 user nova-compute[72520]: INFO nova.compute.claims [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Claim successful on node user
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:38:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.policy [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faa5a76e9ec8400db509e46df8d3221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce093aec44554569978366f3d15b9674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:38:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Creating image(s)
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk 1073741824" returned: 0 in 0.103s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.167s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Cannot resize image /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'migration_context' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Successfully created port: 1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Ensure instance console log exists: /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:38:42 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Successfully updated port: 1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquired lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing instance network info cache due to event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] Acquiring lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating instance_info_cache with network_info: [{"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Releasing lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance network_info: |[{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] Acquired lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Start _get_guest_xml network_info=[{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:38:43 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:43 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-14401138',display_name='tempest-ServerStableDeviceRescueTest-server-14401138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-14401138',id=21,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI99MH/yOy+zyw/6T3gBphmJlKu8fUQAHAInZKk9Q5NAwgz2XPB2/bm1r9zRCsg5BNmCXmkpBXDQlOfDONe6S8PzoZjf2BrdEcciBgaPD6dr7udYlbYRVCJm8xAxw05eng==',key_name='tempest-keypair-1607586224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce093aec44554569978366f3d15b9674',ramdisk_id='',reservation_id='r-mlzy31o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-702900337',owner_user_name='tempest-ServerStableDeviceRescueTest-702900337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:38:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa5a76e9ec8400db509e46df8d3221e',uuid=446c2a07-5fa9-441c-96d8-36d0ca812d1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converting VIF {"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'pci_devices' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:38:43 user nova-compute[72520]:   <uuid>446c2a07-5fa9-441c-96d8-36d0ca812d1b</uuid>
Aug 02 23:38:43 user nova-compute[72520]:   <name>instance-00000015</name>
Aug 02 23:38:43 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:38:43 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:38:43 user nova-compute[72520]:   <metadata>
Aug 02 23:38:43 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:38:43 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:38:43 user nova-compute[72520]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-14401138</nova:name>
Aug 02 23:38:43 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:38:43</nova:creationTime>
Aug 02 23:38:43 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:38:43 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:38:43 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:38:43 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:38:43 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:38:43 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:38:43 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:38:43 user nova-compute[72520]:       <nova:owner>
Aug 02 23:38:43 user nova-compute[72520]:         <nova:user uuid="faa5a76e9ec8400db509e46df8d3221e">tempest-ServerStableDeviceRescueTest-702900337-project-member</nova:user>
Aug 02 23:38:43 user nova-compute[72520]:         <nova:project uuid="ce093aec44554569978366f3d15b9674">tempest-ServerStableDeviceRescueTest-702900337</nova:project>
Aug 02 23:38:43 user nova-compute[72520]:       </nova:owner>
Aug 02 23:38:43 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:38:43 user nova-compute[72520]:       <nova:ports>
Aug 02 23:38:43 user nova-compute[72520]:         <nova:port uuid="1b164377-0056-4bbd-9be0-9c22a46148b6">
Aug 02 23:38:43 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 02 23:38:43 user nova-compute[72520]:         </nova:port>
Aug 02 23:38:43 user nova-compute[72520]:       </nova:ports>
Aug 02 23:38:43 user nova-compute[72520]:     </nova:instance>
Aug 02 23:38:43 user nova-compute[72520]:   </metadata>
Aug 02 23:38:43 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:38:43 user nova-compute[72520]:     <system>
Aug 02 23:38:43 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:38:43 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:38:43 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:38:43 user nova-compute[72520]:       <entry name="serial">446c2a07-5fa9-441c-96d8-36d0ca812d1b</entry>
Aug 02 23:38:43 user nova-compute[72520]:       <entry name="uuid">446c2a07-5fa9-441c-96d8-36d0ca812d1b</entry>
Aug 02 23:38:43 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:38:43 user nova-compute[72520]:     </system>
Aug 02 23:38:43 user nova-compute[72520]:   </sysinfo>
Aug 02 23:38:43 user nova-compute[72520]:   <os>
Aug 02 23:38:43 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:38:43 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:38:43 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:38:43 user nova-compute[72520]:   </os>
Aug 02 23:38:43 user nova-compute[72520]:   <features>
Aug 02 23:38:43 user nova-compute[72520]:     <acpi/>
Aug 02 23:38:43 user nova-compute[72520]:     <apic/>
Aug 02 23:38:43 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:38:43 user nova-compute[72520]:   </features>
Aug 02 23:38:43 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:38:43 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:38:43 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:38:43 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:38:43 user nova-compute[72520]:   </clock>
Aug 02 23:38:43 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:38:43 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:38:43 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:38:43 user nova-compute[72520]:   </cpu>
Aug 02 23:38:43 user nova-compute[72520]:   <devices>
Aug 02 23:38:43 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:38:43 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:38:43 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk"/>
Aug 02 23:38:43 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:38:43 user nova-compute[72520]:     </disk>
Aug 02 23:38:43 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:38:43 user nova-compute[72520]:       <mac address="fa:16:3e:53:22:15"/>
Aug 02 23:38:43 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:38:43 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:38:43 user nova-compute[72520]:       <target dev="tap1b164377-00"/>
Aug 02 23:38:43 user nova-compute[72520]:     </interface>
Aug 02 23:38:43 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:38:43 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/console.log" append="off"/>
Aug 02 23:38:43 user nova-compute[72520]:     </serial>
Aug 02 23:38:43 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:38:43 user nova-compute[72520]:     <video>
Aug 02 23:38:43 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:38:43 user nova-compute[72520]:     </video>
Aug 02 23:38:43 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:38:43 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:38:43 user nova-compute[72520]:     </rng>
Aug 02 23:38:43 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:38:43 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:38:43 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:38:43 user nova-compute[72520]:     </memballoon>
Aug 02 23:38:43 user nova-compute[72520]:   </devices>
Aug 02 23:38:43 user nova-compute[72520]: </domain>
Aug 02 23:38:43 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-14401138',display_name='tempest-ServerStableDeviceRescueTest-server-14401138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-14401138',id=21,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI99MH/yOy+zyw/6T3gBphmJlKu8fUQAHAInZKk9Q5NAwgz2XPB2/bm1r9zRCsg5BNmCXmkpBXDQlOfDONe6S8PzoZjf2BrdEcciBgaPD6dr7udYlbYRVCJm8xAxw05eng==',key_name='tempest-keypair-1607586224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce093aec44554569978366f3d15b9674',ramdisk_id='',reservation_id='r-mlzy31o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-702900337',owner_user_name='tempest-ServerStableDeviceRescueTest-702900337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:38:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa5a76e9ec8400db509e46df8d3221e',uuid=446c2a07-5fa9-441c-96d8-36d0ca812d1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converting VIF {"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG os_vif [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b164377-00, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b164377-00, col_values=(('external_ids', {'iface-id': '1b164377-0056-4bbd-9be0-9c22a46148b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:22:15', 'vm-uuid': '446c2a07-5fa9-441c-96d8-36d0ca812d1b'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:43 user nova-compute[72520]: INFO os_vif [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00')
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No VIF found with MAC fa:16:3e:53:22:15, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updated VIF entry in instance network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:38:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1adb7cd6-c924-4aa4-96fb-2c1607e5b423 req-84c97231-c262-4408-9ab1-888ac389adbb service nova] Releasing lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:38:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-0d1ef2b1-d49f-4464-aa42-18264f8fba0c req-50a40d5e-3548-499c-b2b5-ede4a5cd37a8 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0d1ef2b1-d49f-4464-aa42-18264f8fba0c req-50a40d5e-3548-499c-b2b5-ede4a5cd37a8 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0d1ef2b1-d49f-4464-aa42-18264f8fba0c req-50a40d5e-3548-499c-b2b5-ede4a5cd37a8 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0d1ef2b1-d49f-4464-aa42-18264f8fba0c req-50a40d5e-3548-499c-b2b5-ede4a5cd37a8 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-0d1ef2b1-d49f-4464-aa42-18264f8fba0c req-50a40d5e-3548-499c-b2b5-ede4a5cd37a8 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:45 user nova-compute[72520]: WARNING nova.compute.manager [req-0d1ef2b1-d49f-4464-aa42-18264f8fba0c req-50a40d5e-3548-499c-b2b5-ede4a5cd37a8 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state building and task_state spawning.
Aug 02 23:38:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019526.9050007, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] VM Resumed (Lifecycle Event)
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:38:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance spawned successfully.
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:38:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019526.9062748, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:38:46 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] VM Started (Lifecycle Event)
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:38:47 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:38:47 user nova-compute[72520]: INFO nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 02 23:38:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:38:47 user nova-compute[72520]: INFO nova.compute.manager [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Took 6.52 seconds to build instance.
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f2301d84-14d2-49f8-a621-097cad2ffcf9 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.652s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-40ee55bd-5fa9-4818-b374-6f4d7d7f93b0 req-97e27dfb-73b0-4488-ab03-6c43a2ad9354 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-40ee55bd-5fa9-4818-b374-6f4d7d7f93b0 req-97e27dfb-73b0-4488-ab03-6c43a2ad9354 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-40ee55bd-5fa9-4818-b374-6f4d7d7f93b0 req-97e27dfb-73b0-4488-ab03-6c43a2ad9354 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-40ee55bd-5fa9-4818-b374-6f4d7d7f93b0 req-97e27dfb-73b0-4488-ab03-6c43a2ad9354 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-40ee55bd-5fa9-4818-b374-6f4d7d7f93b0 req-97e27dfb-73b0-4488-ab03-6c43a2ad9354 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:38:47 user nova-compute[72520]: WARNING nova.compute.manager [req-40ee55bd-5fa9-4818-b374-6f4d7d7f93b0 req-97e27dfb-73b0-4488-ab03-6c43a2ad9354 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state None.
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:38:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:50 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7607MB free_disk=25.624332427978516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a425b6aa-bb98-4b02-8263-571f8e1707c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:38:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:38:51 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:38:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:38:51 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:38:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:38:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:38:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:53 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:38:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:38:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:17 user nova-compute[72520]: INFO nova.compute.manager [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attaching volume ee3d973a-3158-449e-b391-0b6d570b22b3 to /dev/vdb
Aug 02 23:39:18 user nova-compute[72520]: DEBUG os_brick.utils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2950b0e7-b439-4d59-b2b5-2473b177f2fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0da2ae-6970-460d-b05c-cded55e4ffb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[632e393b-6353-4533-a558-3311d04e7015]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7185b8a-86db-4e75-94f0-e0d905165ea8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:39:18 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:39:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b194384-a74b-418d-ba8b-7e48f610a64e]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG os_brick.utils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating existing volume attachment record: 64512658-e567-4948-b86b-f4b54b0a99f6 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing instance network info cache due to event network-changed-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] Acquiring lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] Acquired lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Refreshing network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:23 user nova-compute[72520]: INFO nova.compute.manager [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Terminating instance
Aug 02 23:39:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-0693f28f-93cf-402e-8fbc-6c200f289479 req-bad20197-19f6-4fe3-98dd-9dc6842f3d0b service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-unplugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0693f28f-93cf-402e-8fbc-6c200f289479 req-bad20197-19f6-4fe3-98dd-9dc6842f3d0b service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0693f28f-93cf-402e-8fbc-6c200f289479 req-bad20197-19f6-4fe3-98dd-9dc6842f3d0b service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0693f28f-93cf-402e-8fbc-6c200f289479 req-bad20197-19f6-4fe3-98dd-9dc6842f3d0b service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-0693f28f-93cf-402e-8fbc-6c200f289479 req-bad20197-19f6-4fe3-98dd-9dc6842f3d0b service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-unplugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:39:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-0693f28f-93cf-402e-8fbc-6c200f289479 req-bad20197-19f6-4fe3-98dd-9dc6842f3d0b service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-unplugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updated VIF entry in instance network info cache for port af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [{"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ca6d590d-23ba-4623-93f1-3fb218c77258 req-443e0aee-cd15-49f9-8761-3b061607a348 service nova] Releasing lock "refresh_cache-a425b6aa-bb98-4b02-8263-571f8e1707c9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:39:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Instance destroyed successfully.
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.objects.instance [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lazy-loading 'resources' on Instance uuid a425b6aa-bb98-4b02-8263-571f8e1707c9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-522014739',display_name='tempest-TestShelveInstance-server-522014739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-522014739',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJp8n8CjMYdw+emM0jJlP1dj7fHPmzowJCQY1NxYoD+ZAxLa2Nhh9dmWeHuX26M3Sx7M4UsRoHuPvqhDBTv/L1ldI7PEauy1C2jCN/2VvehlhV4D+zVTb318b3UAXM9lg==',key_name='tempest-TestShelveInstance-283917505',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:37:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccfc4fa5c29a48dc9021bbd09b4668f1',ramdisk_id='',reservation_id='r-i23tzsg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-171572139',owner_user_name='tempest-TestShelveInstance-171572139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:37:46Z,user_data=None,user_id='a7420cb0556144b99ef811558ca21e17',uuid=a425b6aa-bb98-4b02-8263-571f8e1707c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converting VIF {"id": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "address": "fa:16:3e:7a:74:7b", "network": {"id": "c560e83c-4ce3-48fa-bfde-2a7930dee2b4", "bridge": "br-int", "label": "tempest-TestShelveInstance-960768349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccfc4fa5c29a48dc9021bbd09b4668f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf7b293b-0a", "ovs_interfaceid": "af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_vif [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf7b293b-0a, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:39:24 user nova-compute[72520]: INFO os_vif [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:74:7b,bridge_name='br-int',has_traffic_filtering=True,id=af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1,network=Network(c560e83c-4ce3-48fa-bfde-2a7930dee2b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf7b293b-0a')
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsqTradz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:24 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace01513-fa6a-471f-b4fa-2797d0afb53d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5459cc1d-5e08-4160-97bd-640e5058635b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:39:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a (non-flash)
Aug 02 23:39:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce440bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd824543-9e63-457c-abeb-b108ef088c0e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[472fce50-f891-4781-85af-6c5f59d0d55f]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6191601-cfb9-4679-89ea-afbeaa7a1953]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f5fb9-828a-4368-aa0f-acaa9b3a11dd]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ff818-02d5-4acd-90c5-4af73a5db2df]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee7ae3-916d-41c8-bc49-f8e9d126d227]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260]
Aug 02 23:39:24 user nova-compute[72520]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a, portal: 172.16.0.220,3260] successful.
Aug 02 23:39:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202cc7f-a6ab-461f-80fd-4ca68d1d418a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[04acb328-e6eb-4093-b24c-11d3b7632e20]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] <== disconnect_volume: return (340ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:39:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Deleting instance files /opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9_del
Aug 02 23:39:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Deletion of /opt/stack/data/nova/instances/a425b6aa-bb98-4b02-8263-571f8e1707c9_del complete
Aug 02 23:39:24 user nova-compute[72520]: INFO nova.compute.manager [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 02 23:39:24 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:39:24 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:39:25 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:25 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Took 0.63 seconds to deallocate network for instance.
Aug 02 23:39:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-ea06a059-640a-4308-9775-850bd70df559 req-d697e158-2b90-465f-8555-cfbad7a5d99e service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea06a059-640a-4308-9775-850bd70df559 req-d697e158-2b90-465f-8555-cfbad7a5d99e service nova] Acquiring lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea06a059-640a-4308-9775-850bd70df559 req-d697e158-2b90-465f-8555-cfbad7a5d99e service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea06a059-640a-4308-9775-850bd70df559 req-d697e158-2b90-465f-8555-cfbad7a5d99e service nova] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-ea06a059-640a-4308-9775-850bd70df559 req-d697e158-2b90-465f-8555-cfbad7a5d99e service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] No waiting events found dispatching network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:39:25 user nova-compute[72520]: WARNING nova.compute.manager [req-ea06a059-640a-4308-9775-850bd70df559 req-d697e158-2b90-465f-8555-cfbad7a5d99e service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received unexpected event network-vif-plugged-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 for instance with vm_state active and task_state deleting.
Aug 02 23:39:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-ea06a059-640a-4308-9775-850bd70df559 req-d697e158-2b90-465f-8555-cfbad7a5d99e service nova] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Received event network-vif-deleted-af7b293b-0a1d-4ae5-83d5-6c38fcd7d4f1 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:26 user nova-compute[72520]: INFO nova.compute.manager [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Took 0.92 seconds to detach 1 volumes for instance.
Aug 02 23:39:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Deleting volume: 4202cc7f-a6ab-461f-80fd-4ca68d1d418a {{(pid=72520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlSvWqhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:26 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:26 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:26 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c80622-b351-4e29-b158-605d04850484]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:39:26 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae15207-8861-473e-965d-6b3264e740aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3] added
Aug 02 23:39:26 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[291209c1-e62d-4ba4-81ea-71282f01b14a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[57666d08-0744-4f57-bfa7-4f742a02d2ee]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlSvWqhV {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlSvWqhV" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[40331171-7622-463b-9d5c-1e64d77ed88b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlSvWqhV'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9be75f6-d00d-49a0-aced-eebedc868e79]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fe2eed-33cf-4f8f-9808-202db63d2266]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:39:26 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:39:26 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:26 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 02 23:39:26 user nova-compute[72520]: 
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[97578dcd-e628-47b3-abb7-cfd0eae7c158]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260]
Aug 02 23:39:26 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260] successful.
Aug 02 23:39:26 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd56b381-8e6c-49b6-b5b5-6192c1a32f8e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d128faf-8095-4028-a085-cee2bf39ac17]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 (non-flash)
Aug 02 23:39:26 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 (non-flash)
Aug 02 23:39:26 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d697b2-a367-4e66-a181-5b4ef3bd0e9e]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlSvWqhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:26 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Deleted allocations for instance a425b6aa-bb98-4b02-8263-571f8e1707c9
Aug 02 23:39:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-544638be-0788-4ce9-9083-8c0257f98247 tempest-TestShelveInstance-171572139 tempest-TestShelveInstance-171572139-project-member] Lock "a425b6aa-bb98-4b02-8263-571f8e1707c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.460s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23364396134376133', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364396134376133', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:39:27 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:39:27 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:39:27 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:39:27 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:39:27 user nova-compute[72520]:   <serial>ee3d973a-3158-449e-b391-0b6d570b22b3</serial>
Aug 02 23:39:27 user nova-compute[72520]: </disk>
Aug 02 23:39:27 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:39:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:39:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:39:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No VIF found with MAC fa:16:3e:98:7d:b0, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:39:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d03720f6-a12d-4f12-bf52-c92c0d94510f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.331s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:30 user nova-compute[72520]: INFO nova.compute.manager [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Detaching volume ee3d973a-3158-449e-b391-0b6d570b22b3
Aug 02 23:39:30 user nova-compute[72520]: INFO nova.virt.block_device [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attempting to driver detach volume ee3d973a-3158-449e-b391-0b6d570b22b3 from mountpoint /dev/vdb
Aug 02 23:39:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Attempting to detach device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:39:30 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:39:30 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:39:30 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:39:30 user nova-compute[72520]:   <serial>ee3d973a-3158-449e-b391-0b6d570b22b3</serial>
Aug 02 23:39:30 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:39:30 user nova-compute[72520]: </disk>
Aug 02 23:39:30 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:39:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config.
Aug 02 23:39:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:39:30 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:39:30 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:39:30 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:39:30 user nova-compute[72520]:   <serial>ee3d973a-3158-449e-b391-0b6d570b22b3</serial>
Aug 02 23:39:30 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:39:30 user nova-compute[72520]: </disk>
Aug 02 23:39:30 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019570.7738013, f0f48878-9b8a-4078-8e7b-763b1331d037 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:39:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config.
Aug 02 23:39:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlSvWqhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:30 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14608851-1ffb-467a-9e96-c83fe7c38954]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe332ef-d374-478a-8513-a89bb10d1e0a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 (non-flash)
Aug 02 23:39:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 (non-flash)
Aug 02 23:39:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4282320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08b2ec7-465e-4a5c-8351-ae9b68e0f52c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[30463eb9-cd8e-4fce-9bff-1dedce088f45]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb55a8-3a0f-4d5d-bee4-ec7a33dd89d5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbb93b4-3d26-4bd8-9103-cd93894d4ea2]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff337e7-ea9b-4398-9e10-f0082c97c519]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39cf276-c4dc-47f6-a9d1-5f2309173313]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260]
Aug 02 23:39:31 user nova-compute[72520]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3, portal: 172.16.0.220,3260] successful.
Aug 02 23:39:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d973a-3158-449e-b391-0b6d570b22b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8c551e-a7ad-4eff-b9ea-0c45a8f984f7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== disconnect_volume: return (279ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG nova.objects.instance [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-741b8ffd-6f31-4711-964e-6cb5074abcbe tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-changed-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Refreshing instance network info cache due to event network-changed-1ef5e1ef-779d-40f6-b581-25edb92d48c0. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:39:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] Acquiring lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:39:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] Acquired lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:39:33 user nova-compute[72520]: DEBUG nova.network.neutron [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Refreshing network info cache for port 1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:39:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:34 user nova-compute[72520]: DEBUG nova.network.neutron [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Updated VIF entry in instance network info cache for port 1ef5e1ef-779d-40f6-b581-25edb92d48c0. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:39:34 user nova-compute[72520]: DEBUG nova.network.neutron [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Updating instance_info_cache with network_info: [{"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e2cbde36-774f-493c-ba6a-56686f5cebbe req-831f25e2-f64a-453b-8102-396176399d01 service nova] Releasing lock "refresh_cache-a07ce9ad-eb58-428f-9db8-6c9c5ce02878" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:39:36 user nova-compute[72520]: INFO nova.compute.claims [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Claim successful on node user
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:39:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:39:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.policy [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cc59aed3bf5406ba8224f8ceb6e21ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d226af347f24fe68dec034ee7dce8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:39:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Creating image(s)
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "/opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "/opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk 1073741824" returned: 0 in 0.064s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid a07ce9ad-eb58-428f-9db8-6c9c5ce02878 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.network.neutron [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Successfully created port: 5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:39:37 user nova-compute[72520]: INFO nova.compute.claims [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Claim successful on node user
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Cannot resize image /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lazy-loading 'migration_context' on Instance uuid bdf4e227-f9cb-4cee-b9ef-c649ca597031 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Ensure instance console log exists: /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:37 user nova-compute[72520]: INFO nova.compute.manager [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Attaching volume 7471f173-05fa-445c-9084-1758092bccb9 to /dev/vdb
Aug 02 23:39:37 user nova-compute[72520]: DEBUG os_brick.utils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e0bb40-729e-45e9-9e6f-9c93ede673e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf9d7e-08b8-4bbd-b021-27cba3055440]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[847d6c73-7de5-4a9a-b63c-07c82f4f2669]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5a0873-f34e-406a-bc25-6c51ac17aeb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:39:38 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a24841-fe74-4fab-b066-56eef4677a9b]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG os_brick.utils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Updating existing volume attachment record: 1909c3dd-bf13-42d8-b633-af54fce8bdbc {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:39:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:39:38 user nova-compute[72520]: INFO nova.virt.block_device [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Booting with blank volume at /dev/vda
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.policy [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3ecb56ac3554ee3b1ef658d9cdd3869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542e5ab2d59245f58d357cf688e30a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Successfully updated port: 5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquired lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-changed-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Refreshing instance network info cache due to event network-changed-5bd1bd8d-d763-4724-baa7-caece32ab2ae. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] Acquiring lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Updating instance_info_cache with network_info: [{"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Releasing lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Instance network_info: |[{"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] Acquired lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.network.neutron [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Refreshing network info cache for port 5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Start _get_guest_xml network_info=[{"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:39:38 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:39:38 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:39:38 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112342475',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112342475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2112342',id=22,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICtHKY84C4vAQqHU6tapaQcEdVZMczalVdnrXA5aI+L86jmhMZvZKHOuHq7ttRUBg9lexCQ2DH9Wsb0B8f12ZpZ4mkK+EADtYAky7lgztw/waRggTojXU1IYEoVffllTw==',key_name='tempest-keypair-87205325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d226af347f24fe68dec034ee7dce8b5',ramdisk_id='',reservation_id='r-9eluyrd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1455741476',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc59aed3bf5406ba8224f8ceb6e21ec',uuid=bdf4e227-f9cb-4cee-b9ef-c649ca597031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Converting VIF {"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:6f,bridge_name='br-int',has_traffic_filtering=True,id=5bd1bd8d-d763-4724-baa7-caece32ab2ae,network=Network(88318ec3-5d6d-46ab-842c-580cc65c464f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd1bd8d-d7') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lazy-loading 'pci_devices' on Instance uuid bdf4e227-f9cb-4cee-b9ef-c649ca597031 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Successfully created port: bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:39:39 user nova-compute[72520]:   <uuid>bdf4e227-f9cb-4cee-b9ef-c649ca597031</uuid>
Aug 02 23:39:39 user nova-compute[72520]:   <name>instance-00000016</name>
Aug 02 23:39:39 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:39:39 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:39:39 user nova-compute[72520]:   <metadata>
Aug 02 23:39:39 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:39:39 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:39:39 user nova-compute[72520]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2112342475</nova:name>
Aug 02 23:39:39 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:39:38</nova:creationTime>
Aug 02 23:39:39 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:39:39 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:39:39 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:39:39 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:39:39 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:39:39 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:39:39 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:39:39 user nova-compute[72520]:       <nova:owner>
Aug 02 23:39:39 user nova-compute[72520]:         <nova:user uuid="0cc59aed3bf5406ba8224f8ceb6e21ec">tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member</nova:user>
Aug 02 23:39:39 user nova-compute[72520]:         <nova:project uuid="6d226af347f24fe68dec034ee7dce8b5">tempest-TestServerVolumeAttachScenarioOldVersion-1455741476</nova:project>
Aug 02 23:39:39 user nova-compute[72520]:       </nova:owner>
Aug 02 23:39:39 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:39:39 user nova-compute[72520]:       <nova:ports>
Aug 02 23:39:39 user nova-compute[72520]:         <nova:port uuid="5bd1bd8d-d763-4724-baa7-caece32ab2ae">
Aug 02 23:39:39 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 02 23:39:39 user nova-compute[72520]:         </nova:port>
Aug 02 23:39:39 user nova-compute[72520]:       </nova:ports>
Aug 02 23:39:39 user nova-compute[72520]:     </nova:instance>
Aug 02 23:39:39 user nova-compute[72520]:   </metadata>
Aug 02 23:39:39 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:39:39 user nova-compute[72520]:     <system>
Aug 02 23:39:39 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:39:39 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:39:39 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:39:39 user nova-compute[72520]:       <entry name="serial">bdf4e227-f9cb-4cee-b9ef-c649ca597031</entry>
Aug 02 23:39:39 user nova-compute[72520]:       <entry name="uuid">bdf4e227-f9cb-4cee-b9ef-c649ca597031</entry>
Aug 02 23:39:39 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:39:39 user nova-compute[72520]:     </system>
Aug 02 23:39:39 user nova-compute[72520]:   </sysinfo>
Aug 02 23:39:39 user nova-compute[72520]:   <os>
Aug 02 23:39:39 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:39:39 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:39:39 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:39:39 user nova-compute[72520]:   </os>
Aug 02 23:39:39 user nova-compute[72520]:   <features>
Aug 02 23:39:39 user nova-compute[72520]:     <acpi/>
Aug 02 23:39:39 user nova-compute[72520]:     <apic/>
Aug 02 23:39:39 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:39:39 user nova-compute[72520]:   </features>
Aug 02 23:39:39 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:39:39 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:39:39 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:39:39 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:39:39 user nova-compute[72520]:   </clock>
Aug 02 23:39:39 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:39:39 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:39:39 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:39:39 user nova-compute[72520]:   </cpu>
Aug 02 23:39:39 user nova-compute[72520]:   <devices>
Aug 02 23:39:39 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:39:39 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:39:39 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk"/>
Aug 02 23:39:39 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:39:39 user nova-compute[72520]:     </disk>
Aug 02 23:39:39 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:39:39 user nova-compute[72520]:       <mac address="fa:16:3e:28:80:6f"/>
Aug 02 23:39:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:39:39 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:39:39 user nova-compute[72520]:       <target dev="tap5bd1bd8d-d7"/>
Aug 02 23:39:39 user nova-compute[72520]:     </interface>
Aug 02 23:39:39 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:39:39 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/console.log" append="off"/>
Aug 02 23:39:39 user nova-compute[72520]:     </serial>
Aug 02 23:39:39 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:39:39 user nova-compute[72520]:     <video>
Aug 02 23:39:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:39:39 user nova-compute[72520]:     </video>
Aug 02 23:39:39 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:39:39 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:39:39 user nova-compute[72520]:     </rng>
Aug 02 23:39:39 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:39:39 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:39:39 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:39:39 user nova-compute[72520]:     </memballoon>
Aug 02 23:39:39 user nova-compute[72520]:   </devices>
Aug 02 23:39:39 user nova-compute[72520]: </domain>
Aug 02 23:39:39 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112342475',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112342475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2112342',id=22,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICtHKY84C4vAQqHU6tapaQcEdVZMczalVdnrXA5aI+L86jmhMZvZKHOuHq7ttRUBg9lexCQ2DH9Wsb0B8f12ZpZ4mkK+EADtYAky7lgztw/waRggTojXU1IYEoVffllTw==',key_name='tempest-keypair-87205325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d226af347f24fe68dec034ee7dce8b5',ramdisk_id='',reservation_id='r-9eluyrd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1455741476',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc59aed3bf5406ba8224f8ceb6e21ec',uuid=bdf4e227-f9cb-4cee-b9ef-c649ca597031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Converting VIF {"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:6f,bridge_name='br-int',has_traffic_filtering=True,id=5bd1bd8d-d763-4724-baa7-caece32ab2ae,network=Network(88318ec3-5d6d-46ab-842c-580cc65c464f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd1bd8d-d7') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG os_vif [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:6f,bridge_name='br-int',has_traffic_filtering=True,id=5bd1bd8d-d763-4724-baa7-caece32ab2ae,network=Network(88318ec3-5d6d-46ab-842c-580cc65c464f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd1bd8d-d7') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd1bd8d-d7, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bd1bd8d-d7, col_values=(('external_ids', {'iface-id': '5bd1bd8d-d763-4724-baa7-caece32ab2ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:80:6f', 'vm-uuid': 'bdf4e227-f9cb-4cee-b9ef-c649ca597031'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:39 user nova-compute[72520]: INFO os_vif [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:6f,bridge_name='br-int',has_traffic_filtering=True,id=5bd1bd8d-d763-4724-baa7-caece32ab2ae,network=Network(88318ec3-5d6d-46ab-842c-580cc65c464f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd1bd8d-d7')
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] No VIF found with MAC fa:16:3e:28:80:6f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019564.2142596, a425b6aa-bb98-4b02-8263-571f8e1707c9 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:39:39 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] VM Stopped (Lifecycle Event)
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-a385e0ef-ec32-4f80-91b6-4abf4a40e4e0 None None] [instance: a425b6aa-bb98-4b02-8263-571f8e1707c9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Updated VIF entry in instance network info cache for port 5bd1bd8d-d763-4724-baa7-caece32ab2ae. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Updating instance_info_cache with network_info: [{"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a910a8b8-2fa1-4c92-acdf-4fc5a10c2124 req-5899dd7d-5762-4a75-bf54-a58e2357fb30 service nova] Releasing lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Successfully updated port: bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-changed-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Refreshing instance network info cache due to event network-changed-bdea32db-5527-45e2-a8ea-970fd468288c. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] Acquiring lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:39:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating instance_info_cache with network_info: [{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance network_info: |[{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] Acquired lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:39:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Refreshing network info cache for port bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updated VIF entry in instance network info cache for port bdea32db-5527-45e2-a8ea-970fd468288c. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating instance_info_cache with network_info: [{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-628b47d7-f8cc-44e8-bdd8-e8a0a433191d req-de2f7bbf-7f0e-4fa5-a13a-ba22d746cae1 service nova] Releasing lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:39:41 user nova-compute[72520]: WARNING nova.compute.manager [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received unexpected event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with vm_state building and task_state spawning.
Aug 02 23:39:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:39:41 user nova-compute[72520]: WARNING nova.compute.manager [req-35a14390-e97a-43a9-b414-b6bc974d55d1 req-9f1bfbf9-dfbf-4690-8a62-1d2fbc67106f service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received unexpected event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with vm_state building and task_state spawning.
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019582.6702747, bdf4e227-f9cb-4cee-b9ef-c649ca597031 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:39:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] VM Resumed (Lifecycle Event)
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:39:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Instance spawned successfully.
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019582.673391, bdf4e227-f9cb-4cee-b9ef-c649ca597031 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:39:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] VM Started (Lifecycle Event)
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:39:42 user nova-compute[72520]: INFO nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 02 23:39:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:39:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:39:42 user nova-compute[72520]: INFO nova.compute.manager [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Took 6.35 seconds to build instance.
Aug 02 23:39:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-75c340d1-1285-4818-a5b8-be6ed9f868f5 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG os_brick.utils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a66b9-1b28-403b-bd1d-c47597ebaf43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b64d7a-64b1-4522-9647-7b04ec0fcc7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d5ced4-bf4c-4c90-8afe-85e42ae2c580]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad3685-9122-47e3-9e69-740846562234]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:39:44 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:39:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a03e1a-cf2e-4781-b8fe-0286a48b34ce]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG os_brick.utils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating existing volume attachment record: d5faae56-4443-4b5b-bd68-bc8026c0e732 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:44 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRMVYdtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:48 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:48 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:48 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f25236-16c6-4e51-8afe-9c8a6c5944e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:39:48 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[16575e54-85ae-415d-b5a2-c495b69e87d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9] added
Aug 02 23:39:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf91f0e-14a4-4308-a34d-386f2885c7f7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610b7ca-ed32-4ccc-a99f-95c477fa4f81]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRMVYdtH {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRMVYdtH" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b439a376-acb2-40ce-af22-42a6e1a3f253]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JRMVYdtH'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c66bda-2914-4de3-9496-d73d54358149]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[69263df2-908c-4fef-818f-78ee0963628f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:39:49 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:39:49 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:49 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 02 23:39:49 user nova-compute[72520]: 
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b166397e-548e-4e66-9cdf-c3e002da979f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260]
Aug 02 23:39:49 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260] successful.
Aug 02 23:39:49 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4fd3e4-dbed-4d31-8aff-6e48b8631aa5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b9ece5-c303-421e-84aa-e68cd9c51f93]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:49 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:49 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d0690-a39c-4bba-a2c8-ae1cec0e518c]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRMVYdtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23937636630373363', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937636630373363', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid a07ce9ad-eb58-428f-9db8-6c9c5ce02878 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:39:50 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:39:50 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:39:50 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:39:50 user nova-compute[72520]:   <serial>7471f173-05fa-445c-9084-1758092bccb9</serial>
Aug 02 23:39:50 user nova-compute[72520]: </disk>
Aug 02 23:39:50 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No VIF found with MAC fa:16:3e:ea:a9:ee, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-37de4d50-524e-48bd-941a-865fdba6bb99 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.132s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:39:52 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7675MB free_disk=25.580486297607422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:39:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Creating image(s)
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Ensure instance console log exists: /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Start _get_guest_xml network_info=[{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhblzHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb121921-3b3c-43dc-ad9a-8aa1d5c49301', 'attached_at': '', 'detached_at': '', 'volume_id': '9e9cd575-25cd-4159-8f5f-e28e8af973a7', 'serial': '9e9cd575-25cd-4159-8f5f-e28e8af973a7'}, 'attachment_id': 'd5faae56-4443-4b5b-bd68-bc8026c0e732', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:39:52 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:39:52 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhblzHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:52 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:52 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:52 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:39:52 user nova-compute[72520]: INFO nova.compute.manager [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Detaching volume 7471f173-05fa-445c-9084-1758092bccb9
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8737e09-3dd5-4fbc-8929-70752c61e774]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:39:52 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7daf36-8b56-417e-b646-973ef790e942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7] added
Aug 02 23:39:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c907f2-67b9-4333-bd57-c634d07aed8c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: INFO nova.virt.block_device [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Attempting to driver detach volume 7471f173-05fa-445c-9084-1758092bccb9 from mountpoint /dev/vdb
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Attempting to detach device vdb from instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:39:52 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:39:52 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:39:52 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:39:52 user nova-compute[72520]:   <serial>7471f173-05fa-445c-9084-1758092bccb9</serial>
Aug 02 23:39:52 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:39:52 user nova-compute[72520]: </disk>
Aug 02 23:39:52 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1a0e1-5c71-4404-a696-8b68b9b09140]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhblzHmW {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully detached device vdb from instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 from the persistent domain config.
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:39:52 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:39:52 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:39:52 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:39:52 user nova-compute[72520]:   <serial>7471f173-05fa-445c-9084-1758092bccb9</serial>
Aug 02 23:39:52 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:39:52 user nova-compute[72520]: </disk>
Aug 02 23:39:52 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhblzHmW" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c55d318-e71d-4d64-829b-fb16b0d45fd3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OhblzHmW'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b6d21e-8e17-43c7-bc19-5d40ff5fc9ff]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6659fbf8-8717-4b9b-bbe7-f349b3ad917f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b799298-88ca-45f1-a960-3a44da5dfcad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260]
Aug 02 23:39:52 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260] successful.
Aug 02 23:39:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b663c4-8788-453f-bf1d-78270ee3ffac]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4640fce5-25dc-47ca-a37b-fe92062d46e3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:52 user nova-compute[72520]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:39:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:52 user nova-compute[72520]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:39:52 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2bb833-169e-4bb4-aff8-90c0b44a59a9]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:39:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhblzHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019593.1827145, a07ce9ad-eb58-428f-9db8-6c9c5ce02878 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:39:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully detached device vdb from instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878 from the live domain config.
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRMVYdtH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:39:53 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23233663538623363', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233663538623363', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.717s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6599bc09-fff9-446d-be12-f764281977df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750341404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750341404',id=23,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-w70ajkgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:39:38Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=fb121921-3b3c-43dc-ad9a-8aa1d5c49301,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'pci_devices' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:39:53 user nova-compute[72520]:   <uuid>fb121921-3b3c-43dc-ad9a-8aa1d5c49301</uuid>
Aug 02 23:39:53 user nova-compute[72520]:   <name>instance-00000017</name>
Aug 02 23:39:53 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:39:53 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:39:53 user nova-compute[72520]:   <metadata>
Aug 02 23:39:53 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:39:53 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:39:53 user nova-compute[72520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-750341404</nova:name>
Aug 02 23:39:53 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:39:52</nova:creationTime>
Aug 02 23:39:53 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:39:53 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:39:53 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:39:53 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:39:53 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:39:53 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:39:53 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:39:53 user nova-compute[72520]:       <nova:owner>
Aug 02 23:39:53 user nova-compute[72520]:         <nova:user uuid="f3ecb56ac3554ee3b1ef658d9cdd3869">tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member</nova:user>
Aug 02 23:39:53 user nova-compute[72520]:         <nova:project uuid="542e5ab2d59245f58d357cf688e30a43">tempest-ServerBootFromVolumeStableRescueTest-1108272558</nova:project>
Aug 02 23:39:53 user nova-compute[72520]:       </nova:owner>
Aug 02 23:39:53 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:39:53 user nova-compute[72520]:       <nova:ports>
Aug 02 23:39:53 user nova-compute[72520]:         <nova:port uuid="bdea32db-5527-45e2-a8ea-970fd468288c">
Aug 02 23:39:53 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 02 23:39:53 user nova-compute[72520]:         </nova:port>
Aug 02 23:39:53 user nova-compute[72520]:       </nova:ports>
Aug 02 23:39:53 user nova-compute[72520]:     </nova:instance>
Aug 02 23:39:53 user nova-compute[72520]:   </metadata>
Aug 02 23:39:53 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:39:53 user nova-compute[72520]:     <system>
Aug 02 23:39:53 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:39:53 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:39:53 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:39:53 user nova-compute[72520]:       <entry name="serial">fb121921-3b3c-43dc-ad9a-8aa1d5c49301</entry>
Aug 02 23:39:53 user nova-compute[72520]:       <entry name="uuid">fb121921-3b3c-43dc-ad9a-8aa1d5c49301</entry>
Aug 02 23:39:53 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:39:53 user nova-compute[72520]:     </system>
Aug 02 23:39:53 user nova-compute[72520]:   </sysinfo>
Aug 02 23:39:53 user nova-compute[72520]:   <os>
Aug 02 23:39:53 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:39:53 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:39:53 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:39:53 user nova-compute[72520]:   </os>
Aug 02 23:39:53 user nova-compute[72520]:   <features>
Aug 02 23:39:53 user nova-compute[72520]:     <acpi/>
Aug 02 23:39:53 user nova-compute[72520]:     <apic/>
Aug 02 23:39:53 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:39:53 user nova-compute[72520]:   </features>
Aug 02 23:39:53 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:39:53 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:39:53 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:39:53 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:39:53 user nova-compute[72520]:   </clock>
Aug 02 23:39:53 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:39:53 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:39:53 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:39:53 user nova-compute[72520]:   </cpu>
Aug 02 23:39:53 user nova-compute[72520]:   <devices>
Aug 02 23:39:53 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:39:53 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:39:53 user nova-compute[72520]:       <source dev="/dev/sdc"/>
Aug 02 23:39:53 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:39:53 user nova-compute[72520]:       <serial>9e9cd575-25cd-4159-8f5f-e28e8af973a7</serial>
Aug 02 23:39:53 user nova-compute[72520]:     </disk>
Aug 02 23:39:53 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:39:53 user nova-compute[72520]:       <mac address="fa:16:3e:6d:db:2a"/>
Aug 02 23:39:53 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:39:53 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:39:53 user nova-compute[72520]:       <target dev="tapbdea32db-55"/>
Aug 02 23:39:53 user nova-compute[72520]:     </interface>
Aug 02 23:39:53 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:39:53 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/console.log" append="off"/>
Aug 02 23:39:53 user nova-compute[72520]:     </serial>
Aug 02 23:39:53 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:39:53 user nova-compute[72520]:     <video>
Aug 02 23:39:53 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:39:53 user nova-compute[72520]:     </video>
Aug 02 23:39:53 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:39:53 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:39:53 user nova-compute[72520]:     </rng>
Aug 02 23:39:53 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:39:53 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:39:53 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:39:53 user nova-compute[72520]:     </memballoon>
Aug 02 23:39:53 user nova-compute[72520]:   </devices>
Aug 02 23:39:53 user nova-compute[72520]: </domain>
Aug 02 23:39:53 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750341404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750341404',id=23,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-w70ajkgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:39:38Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=fb121921-3b3c-43dc-ad9a-8aa1d5c49301,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_vif [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42512ab7-11f1-468b-8bce-b9693a3be4ac]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:53 user nova-compute[72520]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:39:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 (non-flash)
Aug 02 23:39:53 user nova-compute[72520]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:39:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce42752d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdea32db-55, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdea32db-55, col_values=(('external_ids', {'iface-id': 'bdea32db-5527-45e2-a8ea-970fd468288c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:db:2a', 'vm-uuid': 'fb121921-3b3c-43dc-ad9a-8aa1d5c49301'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:39:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:53 user nova-compute[72520]: INFO os_vif [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55')
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[96778de6-3dd7-426a-bfb4-15dcefff14d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aa649d-eb77-4686-ac9b-9b86aaa46877]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc19a3-a9af-4a9e-9cda-6e71b29705ed]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No VIF found with MAC fa:16:3e:6d:db:2a, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9b30c4-e85a-45e2-a208-73e3529a7407]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5398c0a0-74ab-4654-89bd-29325848e95a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5749b937-c8e0-4455-8775-a216624ab8fd]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260]
Aug 02 23:39:54 user nova-compute[72520]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9, portal: 172.16.0.220,3260] successful.
Aug 02 23:39:54 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7471f173-05fa-445c-9084-1758092bccb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[103bebce-89ce-4fb6-832e-80c05e2be9f8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== disconnect_volume: return (1052ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG nova.objects.instance [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid a07ce9ad-eb58-428f-9db8-6c9c5ce02878 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7fb97646-9068-4059-b241-43b162516a73 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.786s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-37f8c187-0747-4a46-940d-9db0b50060f3 req-7300f016-e8c9-4fbd-bbf5-471d2ccadc54 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37f8c187-0747-4a46-940d-9db0b50060f3 req-7300f016-e8c9-4fbd-bbf5-471d2ccadc54 service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37f8c187-0747-4a46-940d-9db0b50060f3 req-7300f016-e8c9-4fbd-bbf5-471d2ccadc54 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37f8c187-0747-4a46-940d-9db0b50060f3 req-7300f016-e8c9-4fbd-bbf5-471d2ccadc54 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-37f8c187-0747-4a46-940d-9db0b50060f3 req-7300f016-e8c9-4fbd-bbf5-471d2ccadc54 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:39:55 user nova-compute[72520]: WARNING nova.compute.manager [req-37f8c187-0747-4a46-940d-9db0b50060f3 req-7300f016-e8c9-4fbd-bbf5-471d2ccadc54 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state building and task_state spawning.
Aug 02 23:39:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019597.6366727, fb121921-3b3c-43dc-ad9a-8aa1d5c49301 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:39:57 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] VM Resumed (Lifecycle Event)
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:39:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance spawned successfully.
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:39:57 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019597.6382098, fb121921-3b3c-43dc-ad9a-8aa1d5c49301 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:39:57 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] VM Started (Lifecycle Event)
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:39:57 user nova-compute[72520]: INFO nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:39:57 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:39:57 user nova-compute[72520]: INFO nova.compute.manager [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Took 20.24 seconds to build instance.
Aug 02 23:39:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e93e9b-ad39-42e9-a746-136ffbc38472 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.363s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-d61e8a61-4f78-4cb9-b739-a53619543f21 req-70717bef-301d-4617-8af8-d8d5eb76cdf5 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d61e8a61-4f78-4cb9-b739-a53619543f21 req-70717bef-301d-4617-8af8-d8d5eb76cdf5 service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d61e8a61-4f78-4cb9-b739-a53619543f21 req-70717bef-301d-4617-8af8-d8d5eb76cdf5 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d61e8a61-4f78-4cb9-b739-a53619543f21 req-70717bef-301d-4617-8af8-d8d5eb76cdf5 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:39:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-d61e8a61-4f78-4cb9-b739-a53619543f21 req-70717bef-301d-4617-8af8-d8d5eb76cdf5 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:39:57 user nova-compute[72520]: WARNING nova.compute.manager [req-d61e8a61-4f78-4cb9-b739-a53619543f21 req-70717bef-301d-4617-8af8-d8d5eb76cdf5 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state active and task_state None.
Aug 02 23:39:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:39:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-changed-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:40:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Refreshing instance network info cache due to event network-changed-ad1bea50-6df7-41da-b7db-48366aeb40b3. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:40:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] Acquiring lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:40:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] Acquired lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:40:11 user nova-compute[72520]: DEBUG nova.network.neutron [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Refreshing network info cache for port ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:40:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updated VIF entry in instance network info cache for port ad1bea50-6df7-41da-b7db-48366aeb40b3. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:40:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:40:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4598dfb4-32d0-4cfd-824f-2ccd2d077772 req-94d51f99-9b29-474b-8b97-abd3c9fe3048 service nova] Releasing lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:40:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:24 user nova-compute[72520]: INFO nova.compute.manager [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attaching volume f58a3a27-eb5d-431d-85c9-8705658e7ad1 to /dev/vdb
Aug 02 23:40:24 user nova-compute[72520]: DEBUG os_brick.utils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af7c12a-6cad-430c-943f-583650ca1a2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fbf0fd-a6fe-4be6-a451-43006ce3730d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c204d8e-29d6-4095-bbd0-7167e7ab680c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1936d9-0064-47c2-bb6c-f6c4efdfa5c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:40:24 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:40:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cf2d99-391e-4522-b41e-ed4440b3deb5]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG os_brick.utils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:40:24 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating existing volume attachment record: c5c98133-9fd0-4d6d-857a-338f9d927e95 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:40:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:40:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing instance network info cache due to event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:40:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] Acquiring lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:40:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] Acquired lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:40:31 user nova-compute[72520]: DEBUG nova.network.neutron [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbFkGgeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:40:32 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:40:32 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:40:32 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba2978-e532-4245-a5cc-1d63b9daa77f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:40:32 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dbfe26-5221-48ab-b3d3-0cf87ff3c76a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1] added
Aug 02 23:40:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec988629-db43-4af6-b9a5-09d9a16aea95]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f290e999-e81d-4ad1-892b-6168b33dc9b4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbFkGgeS {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbFkGgeS" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f81943-69fe-49b6-93d3-96b834670ad3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbFkGgeS'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b7290b-f8ef-4a30-804f-1181cf1ce3e6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff1965e-1395-43f2-a245-a6f292d10752]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:40:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:40:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[793a2c30-e078-484a-9197-4dad2d60124d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260]
Aug 02 23:40:32 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260] successful.
Aug 02 23:40:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ef5563-7f09-4731-b061-1e5db63954d2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[be337767-ccf9-44bb-957b-fe6f60880259]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:40:32 user nova-compute[72520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 (non-flash)
Aug 02 23:40:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:40:32 user nova-compute[72520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 (non-flash)
Aug 02 23:40:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG nova.network.neutron [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updated VIF entry in instance network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG nova.network.neutron [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[16832729-b038-4db7-b7ce-fbba134f8956]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbFkGgeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:40:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b321d620-1cd8-44c3-a955-469fc7a145d0 req-c4ab22f0-1d30-456e-a813-1ba7ea3bb44d service nova] Releasing lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG nova.compute.manager [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:40:33 user nova-compute[72520]: INFO nova.compute.manager [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] instance snapshotting
Aug 02 23:40:33 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Beginning live snapshot process
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23732613133373264', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732613133373264', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:40:33 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:40:33 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:40:33 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:40:33 user nova-compute[72520]:   <serial>f58a3a27-eb5d-431d-85c9-8705658e7ad1</serial>
Aug 02 23:40:33 user nova-compute[72520]: </disk>
Aug 02 23:40:33 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0to903h/5242434cf68d444cad6e1c460253005a.delta 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0to903h/5242434cf68d444cad6e1c460253005a.delta 1073741824" returned: 0 in 0.048s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:33 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 02 23:40:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:40:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] No VIF found with MAC fa:16:3e:98:7d:b0, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:40:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6faf9994-8ed8-4c07-924b-4e5ec495dc75 tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.372s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:40:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:40:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 02 23:40:35 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:40:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0to903h/5242434cf68d444cad6e1c460253005a.delta /opt/stack/data/nova/instances/snapshots/tmps0to903h/5242434cf68d444cad6e1c460253005a {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0to903h/5242434cf68d444cad6e1c460253005a.delta /opt/stack/data/nova/instances/snapshots/tmps0to903h/5242434cf68d444cad6e1c460253005a" returned: 0 in 0.431s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Snapshot extracted, beginning image upload
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:36 user nova-compute[72520]: INFO nova.compute.manager [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Detaching volume f58a3a27-eb5d-431d-85c9-8705658e7ad1
Aug 02 23:40:36 user nova-compute[72520]: INFO nova.virt.block_device [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Attempting to driver detach volume f58a3a27-eb5d-431d-85c9-8705658e7ad1 from mountpoint /dev/vdb
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Attempting to detach device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:40:36 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:40:36 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:40:36 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:40:36 user nova-compute[72520]:   <serial>f58a3a27-eb5d-431d-85c9-8705658e7ad1</serial>
Aug 02 23:40:36 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:40:36 user nova-compute[72520]: </disk>
Aug 02 23:40:36 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:40:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the persistent domain config.
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:40:36 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:40:36 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:40:36 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:40:36 user nova-compute[72520]:   <serial>f58a3a27-eb5d-431d-85c9-8705658e7ad1</serial>
Aug 02 23:40:36 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:40:36 user nova-compute[72520]: </disk>
Aug 02 23:40:36 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019636.67972, f0f48878-9b8a-4078-8e7b-763b1331d037 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:40:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully detached device vdb from instance f0f48878-9b8a-4078-8e7b-763b1331d037 from the live domain config.
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbFkGgeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:40:36 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1b7b28-7a60-4e6a-af1c-793787d70100]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f975d2-cfe4-4698-973e-67624cbcd346]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:40:36 user nova-compute[72520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 (non-flash)
Aug 02 23:40:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:40:36 user nova-compute[72520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 (non-flash)
Aug 02 23:40:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce42824d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8371d20b-f337-4dab-a532-80be1a6024c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb342e-ee97-472d-8e81-6c35f41cf00f]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8e7a6a-b398-49ab-b272-ccefdea456a1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b143ab-7d65-485b-9e4b-95cd3b00401e]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd036f0d-5723-47b5-aa13-600d2cb1930e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[683aea43-dc45-4e41-9163-d6ad8c20874d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260]
Aug 02 23:40:36 user nova-compute[72520]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1, portal: 172.16.0.220,3260] successful.
Aug 02 23:40:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58a3a27-eb5d-431d-85c9-8705658e7ad1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d464fd-9f31-4b3c-a7d1-371adb5d3804]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] <== disconnect_volume: return (262ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:40:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:40:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'flavor' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:40:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-07096d7c-30e6-42f5-afec-506ea6c2452f tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.564s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Snapshot image upload complete
Aug 02 23:40:37 user nova-compute[72520]: INFO nova.compute.manager [None req-3682abc5-6309-4201-834b-bcd1f08b45bf tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Took 4.72 seconds to snapshot the instance on the hypervisor.
Aug 02 23:40:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:42 user nova-compute[72520]: INFO nova.compute.manager [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Terminating instance
Aug 02 23:40:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-7552753b-02be-4001-9e24-ccbef318296e req-a65a6825-4642-4013-83cb-083e192ea84a service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-vif-unplugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7552753b-02be-4001-9e24-ccbef318296e req-a65a6825-4642-4013-83cb-083e192ea84a service nova] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7552753b-02be-4001-9e24-ccbef318296e req-a65a6825-4642-4013-83cb-083e192ea84a service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7552753b-02be-4001-9e24-ccbef318296e req-a65a6825-4642-4013-83cb-083e192ea84a service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-7552753b-02be-4001-9e24-ccbef318296e req-a65a6825-4642-4013-83cb-083e192ea84a service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] No waiting events found dispatching network-vif-unplugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-7552753b-02be-4001-9e24-ccbef318296e req-a65a6825-4642-4013-83cb-083e192ea84a service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-vif-unplugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:40:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Instance destroyed successfully.
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.objects.instance [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'resources' on Instance uuid a07ce9ad-eb58-428f-9db8-6c9c5ce02878 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1035952291',display_name='tempest-AttachVolumeNegativeTest-server-1035952291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1035952291',id=19,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1R3DFquA1flNJkdxQ3YEXG9ibQJmUNAF5RwuywlL61/yJjDf7i6YuDfLPIfIZ2BbYzgHT0gA4H6DUvEndrsrj4lP6CLzyWBsiJZhSEiZhqfYzS3zE0iWzAkQ4ZWCrJzQ==',key_name='tempest-keypair-355210541',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:37:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-nq0oieoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=a07ce9ad-eb58-428f-9db8-6c9c5ce02878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "address": "fa:16:3e:ea:a9:ee", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef5e1ef-77", "ovs_interfaceid": "1ef5e1ef-779d-40f6-b581-25edb92d48c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ef5e1ef-779d-40f6-b581-25edb92d48c0,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef5e1ef-77') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG os_vif [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ef5e1ef-779d-40f6-b581-25edb92d48c0,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef5e1ef-77') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ef5e1ef-77, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:40:43 user nova-compute[72520]: INFO os_vif [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a9:ee,bridge_name='br-int',has_traffic_filtering=True,id=1ef5e1ef-779d-40f6-b581-25edb92d48c0,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef5e1ef-77')
Aug 02 23:40:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Deleting instance files /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878_del
Aug 02 23:40:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Deletion of /opt/stack/data/nova/instances/a07ce9ad-eb58-428f-9db8-6c9c5ce02878_del complete
Aug 02 23:40:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:43 user nova-compute[72520]: INFO nova.compute.manager [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 02 23:40:43 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:40:43 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:40:44 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:40:44 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Took 0.84 seconds to deallocate network for instance.
Aug 02 23:40:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-1321ece7-294e-4b47-91d6-f343dfeaf3c1 req-ea3f442a-0237-458f-b17d-4b4cc7c1aebf service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-vif-deleted-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:40:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:44 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:40:44 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:40:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:44 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Deleted allocations for instance a07ce9ad-eb58-428f-9db8-6c9c5ce02878
Aug 02 23:40:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cad3c188-0e58-4532-9daa-58a9e586b6c4 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-2ae89b06-50da-44c6-8d48-46054ce51275 req-6f287ab1-aee5-40ec-bb46-e5095d29dc9a service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received event network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ae89b06-50da-44c6-8d48-46054ce51275 req-6f287ab1-aee5-40ec-bb46-e5095d29dc9a service nova] Acquiring lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ae89b06-50da-44c6-8d48-46054ce51275 req-6f287ab1-aee5-40ec-bb46-e5095d29dc9a service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ae89b06-50da-44c6-8d48-46054ce51275 req-6f287ab1-aee5-40ec-bb46-e5095d29dc9a service nova] Lock "a07ce9ad-eb58-428f-9db8-6c9c5ce02878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-2ae89b06-50da-44c6-8d48-46054ce51275 req-6f287ab1-aee5-40ec-bb46-e5095d29dc9a service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] No waiting events found dispatching network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:40:45 user nova-compute[72520]: WARNING nova.compute.manager [req-2ae89b06-50da-44c6-8d48-46054ce51275 req-6f287ab1-aee5-40ec-bb46-e5095d29dc9a service nova] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Received unexpected event network-vif-plugged-1ef5e1ef-779d-40f6-b581-25edb92d48c0 for instance with vm_state deleted and task_state None.
Aug 02 23:40:45 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:40:45 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:49 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:40:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:40:53 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:40:53 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=25.520408630371094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:40:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:40:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:40:56 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:40:58 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019643.5136635, a07ce9ad-eb58-428f-9db8-6c9c5ce02878 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:40:58 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] VM Stopped (Lifecycle Event)
Aug 02 23:40:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ad248ca7-3fa9-4d16-9394-ee4f0d5afac1 None None] [instance: a07ce9ad-eb58-428f-9db8-6c9c5ce02878] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:40:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:41:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:41:16 user nova-compute[72520]: INFO nova.compute.manager [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Rescuing
Aug 02 23:41:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:41:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:41:16 user nova-compute[72520]: DEBUG nova.network.neutron [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:41:16 user nova-compute[72520]: DEBUG nova.network.neutron [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-2303868a-5895-4aa4-b170-bb357e469a08 req-f36a7507-049f-4272-9e7e-3ee44c65501b service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2303868a-5895-4aa4-b170-bb357e469a08 req-f36a7507-049f-4272-9e7e-3ee44c65501b service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2303868a-5895-4aa4-b170-bb357e469a08 req-f36a7507-049f-4272-9e7e-3ee44c65501b service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2303868a-5895-4aa4-b170-bb357e469a08 req-f36a7507-049f-4272-9e7e-3ee44c65501b service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-2303868a-5895-4aa4-b170-bb357e469a08 req-f36a7507-049f-4272-9e7e-3ee44c65501b service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:17 user nova-compute[72520]: WARNING nova.compute.manager [req-2303868a-5895-4aa4-b170-bb357e469a08 req-f36a7507-049f-4272-9e7e-3ee44c65501b service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state active and task_state rescuing.
Aug 02 23:41:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance destroyed successfully.
Aug 02 23:41:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Attempting rescue
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 02 23:41:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Creating image(s)
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'trusted_certs' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue" returned: 0 in 0.051s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'migration_context' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Start _get_guest_xml network_info=[{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:de:bc:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'resources' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'numa_topology' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:17 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:17 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944685915',display_name='tempest-ServerRescueNegativeTestJSON-server-944685915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944685915',id=16,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-5exu2j08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:36:41Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:de:bc:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:de:bc:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'pci_devices' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:41:17 user nova-compute[72520]:   <uuid>f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf</uuid>
Aug 02 23:41:17 user nova-compute[72520]:   <name>instance-00000010</name>
Aug 02 23:41:17 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:41:17 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:41:17 user nova-compute[72520]:   <metadata>
Aug 02 23:41:17 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:41:17 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:41:17 user nova-compute[72520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-944685915</nova:name>
Aug 02 23:41:17 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:41:17</nova:creationTime>
Aug 02 23:41:17 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:41:17 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:41:17 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:41:17 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:41:17 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:41:17 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:41:17 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:41:17 user nova-compute[72520]:       <nova:owner>
Aug 02 23:41:17 user nova-compute[72520]:         <nova:user uuid="d02269696a0d47738d8daa53d44b3b70">tempest-ServerRescueNegativeTestJSON-1442912244-project-member</nova:user>
Aug 02 23:41:17 user nova-compute[72520]:         <nova:project uuid="cb887059a9634cce9f17319a980a18f4">tempest-ServerRescueNegativeTestJSON-1442912244</nova:project>
Aug 02 23:41:17 user nova-compute[72520]:       </nova:owner>
Aug 02 23:41:17 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:41:17 user nova-compute[72520]:       <nova:ports>
Aug 02 23:41:17 user nova-compute[72520]:         <nova:port uuid="adfb39f0-4b80-4170-b389-d4d0fe8cd860">
Aug 02 23:41:17 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:41:17 user nova-compute[72520]:         </nova:port>
Aug 02 23:41:17 user nova-compute[72520]:       </nova:ports>
Aug 02 23:41:17 user nova-compute[72520]:     </nova:instance>
Aug 02 23:41:17 user nova-compute[72520]:   </metadata>
Aug 02 23:41:17 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:41:17 user nova-compute[72520]:     <system>
Aug 02 23:41:17 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:41:17 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:41:17 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:41:17 user nova-compute[72520]:       <entry name="serial">f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf</entry>
Aug 02 23:41:17 user nova-compute[72520]:       <entry name="uuid">f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf</entry>
Aug 02 23:41:17 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:41:17 user nova-compute[72520]:     </system>
Aug 02 23:41:17 user nova-compute[72520]:   </sysinfo>
Aug 02 23:41:17 user nova-compute[72520]:   <os>
Aug 02 23:41:17 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:41:17 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:41:17 user nova-compute[72520]:   </os>
Aug 02 23:41:17 user nova-compute[72520]:   <features>
Aug 02 23:41:17 user nova-compute[72520]:     <acpi/>
Aug 02 23:41:17 user nova-compute[72520]:     <apic/>
Aug 02 23:41:17 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:41:17 user nova-compute[72520]:   </features>
Aug 02 23:41:17 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:41:17 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:41:17 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:41:17 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:41:17 user nova-compute[72520]:   </clock>
Aug 02 23:41:17 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:41:17 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:41:17 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:41:17 user nova-compute[72520]:   </cpu>
Aug 02 23:41:17 user nova-compute[72520]:   <devices>
Aug 02 23:41:17 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:41:17 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:41:17 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue"/>
Aug 02 23:41:17 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:41:17 user nova-compute[72520]:     </disk>
Aug 02 23:41:17 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:41:17 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:41:17 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk"/>
Aug 02 23:41:17 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:41:17 user nova-compute[72520]:     </disk>
Aug 02 23:41:17 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:41:17 user nova-compute[72520]:       <mac address="fa:16:3e:de:bc:6e"/>
Aug 02 23:41:17 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:41:17 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:41:17 user nova-compute[72520]:       <target dev="tapadfb39f0-4b"/>
Aug 02 23:41:17 user nova-compute[72520]:     </interface>
Aug 02 23:41:17 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:41:17 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/console.log" append="off"/>
Aug 02 23:41:17 user nova-compute[72520]:     </serial>
Aug 02 23:41:17 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:41:17 user nova-compute[72520]:     <video>
Aug 02 23:41:17 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:41:17 user nova-compute[72520]:     </video>
Aug 02 23:41:17 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:41:17 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:41:17 user nova-compute[72520]:     </rng>
Aug 02 23:41:17 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:41:17 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:41:17 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:41:17 user nova-compute[72520]:     </memballoon>
Aug 02 23:41:17 user nova-compute[72520]:   </devices>
Aug 02 23:41:17 user nova-compute[72520]: </domain>
Aug 02 23:41:17 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:41:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance destroyed successfully.
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:41:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No VIF found with MAC fa:16:3e:de:bc:6e, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:41:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-cde13a0e-0933-403f-a767-f46f6d82ae88 req-5cae15d0-8ac8-40c4-8027-ae6d2daba24e service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cde13a0e-0933-403f-a767-f46f6d82ae88 req-5cae15d0-8ac8-40c4-8027-ae6d2daba24e service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cde13a0e-0933-403f-a767-f46f6d82ae88 req-5cae15d0-8ac8-40c4-8027-ae6d2daba24e service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cde13a0e-0933-403f-a767-f46f6d82ae88 req-5cae15d0-8ac8-40c4-8027-ae6d2daba24e service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-cde13a0e-0933-403f-a767-f46f6d82ae88 req-5cae15d0-8ac8-40c4-8027-ae6d2daba24e service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:19 user nova-compute[72520]: WARNING nova.compute.manager [req-cde13a0e-0933-403f-a767-f46f6d82ae88 req-5cae15d0-8ac8-40c4-8027-ae6d2daba24e service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state active and task_state rescuing.
Aug 02 23:41:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:21 user nova-compute[72520]: WARNING nova.compute.manager [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state active and task_state rescuing.
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:21 user nova-compute[72520]: WARNING nova.compute.manager [req-0833defb-a991-4c64-8644-3739a0694acf req-d8678e03-f2dd-4c4e-8536-1004e50067be service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state active and task_state rescuing.
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019681.4270177, f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:41:21 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] VM Resumed (Lifecycle Event)
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-fa253a2d-f946-47d7-9ca8-3176a006c186 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:41:21 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019681.4343102, f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:41:21 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] VM Started (Lifecycle Event)
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:41:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-changed-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Refreshing instance network info cache due to event network-changed-5bd1bd8d-d763-4724-baa7-caece32ab2ae. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:41:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] Acquiring lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:41:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] Acquired lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:41:27 user nova-compute[72520]: DEBUG nova.network.neutron [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Refreshing network info cache for port 5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:41:28 user nova-compute[72520]: DEBUG nova.network.neutron [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Updated VIF entry in instance network info cache for port 5bd1bd8d-d763-4724-baa7-caece32ab2ae. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:41:28 user nova-compute[72520]: DEBUG nova.network.neutron [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Updating instance_info_cache with network_info: [{"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b871eaab-ebd5-4738-9613-98432c8f267e req-98ba02e4-7087-43e4-b771-701a00996c60 service nova] Releasing lock "refresh_cache-bdf4e227-f9cb-4cee-b9ef-c649ca597031" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:41:28 user nova-compute[72520]: INFO nova.compute.manager [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Rescuing
Aug 02 23:41:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:41:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:41:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:41:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating instance_info_cache with network_info: [{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-39f63173-53d7-41a3-8970-d167ae0dd14d req-6846f510-663b-48c2-9a28-fdb301617bc7 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-39f63173-53d7-41a3-8970-d167ae0dd14d req-6846f510-663b-48c2-9a28-fdb301617bc7 service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-39f63173-53d7-41a3-8970-d167ae0dd14d req-6846f510-663b-48c2-9a28-fdb301617bc7 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-39f63173-53d7-41a3-8970-d167ae0dd14d req-6846f510-663b-48c2-9a28-fdb301617bc7 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-39f63173-53d7-41a3-8970-d167ae0dd14d req-6846f510-663b-48c2-9a28-fdb301617bc7 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:29 user nova-compute[72520]: WARNING nova.compute.manager [req-39f63173-53d7-41a3-8970-d167ae0dd14d req-6846f510-663b-48c2-9a28-fdb301617bc7 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state active and task_state rescuing.
Aug 02 23:41:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance destroyed successfully.
Aug 02 23:41:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Attempting a stable device rescue
Aug 02 23:41:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 02 23:41:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 02 23:41:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Creating image(s)
Aug 02 23:41:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:30 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "1d005ef2821317fca23a05c2f5e4304bd2696b07" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "1d005ef2821317fca23a05c2f5e4304bd2696b07" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG nova.virt.images [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] 9afed593-41a0-4688-a71d-e67b00b50c8b was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.part /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-7ee90243-a671-44c7-b6e1-81c69bd55ebd req-5cde06f0-9e26-4516-9839-e251cb71e2d2 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7ee90243-a671-44c7-b6e1-81c69bd55ebd req-5cde06f0-9e26-4516-9839-e251cb71e2d2 service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7ee90243-a671-44c7-b6e1-81c69bd55ebd req-5cde06f0-9e26-4516-9839-e251cb71e2d2 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7ee90243-a671-44c7-b6e1-81c69bd55ebd req-5cde06f0-9e26-4516-9839-e251cb71e2d2 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-7ee90243-a671-44c7-b6e1-81c69bd55ebd req-5cde06f0-9e26-4516-9839-e251cb71e2d2 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:31 user nova-compute[72520]: WARNING nova.compute.manager [req-7ee90243-a671-44c7-b6e1-81c69bd55ebd req-5cde06f0-9e26-4516-9839-e251cb71e2d2 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state active and task_state rescuing.
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.part /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.converted" returned: 0 in 0.370s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG nova.objects.instance [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lazy-loading 'flavor' on Instance uuid bdf4e227-f9cb-4cee-b9ef-c649ca597031 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "1d005ef2821317fca23a05c2f5e4304bd2696b07" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.773s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "1d005ef2821317fca23a05c2f5e4304bd2696b07" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "1d005ef2821317fca23a05c2f5e4304bd2696b07" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:32 user nova-compute[72520]: INFO nova.compute.manager [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Attaching volume bbd4a47c-e789-4ac8-8f4c-2801462c719c to /dev/vdb
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07 --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07,backing_fmt=raw /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07,backing_fmt=raw /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue" returned: 0 in 0.055s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "1d005ef2821317fca23a05c2f5e4304bd2696b07" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'migration_context' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Start _get_guest_xml network_info=[{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "vif_mac": "fa:16:3e:6d:db:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9afed593-41a0-4688-a71d-e67b00b50c8b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhblzHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fb121921-3b3c-43dc-ad9a-8aa1d5c49301', 'attached_at': '', 'detached_at': '', 'volume_id': '9e9cd575-25cd-4159-8f5f-e28e8af973a7', 'serial': '9e9cd575-25cd-4159-8f5f-e28e8af973a7'}, 'attachment_id': 'd5faae56-4443-4b5b-bd68-bc8026c0e732', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'resources' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf16f7c8-4f0c-4ada-ab0a-7ee99f3f5d0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'numa_topology' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b13b1e-e159-4af4-a05b-43d8224894f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:32 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3534481-5955-46a9-8dca-99c5288bf1b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf37dab1-4aec-4254-8b4f-1d1750e524d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhblzHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:41:32 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:41:32 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:41:32 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:41:32 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d7ea3-5aff-4753-b4b6-6b539aa8d02b]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Updating existing volume attachment record: bdc11221-f992-4a47-9985-0ea3eb29eb36 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7695ba-557b-42ed-8286-420225467748]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OhblzHmW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 02 23:41:32 user nova-compute[72520]: node.name = iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7
Aug 02 23:41:32 user nova-compute[72520]: node.tpgt = -1
Aug 02 23:41:32 user nova-compute[72520]: node.startup = automatic
Aug 02 23:41:32 user nova-compute[72520]: node.leading_login = No
Aug 02 23:41:32 user nova-compute[72520]: iface.iscsi_ifacename = default
Aug 02 23:41:32 user nova-compute[72520]: iface.net_ifacename = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.ipaddress = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.prefix_len = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.hwaddress = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.transport_name = tcp
Aug 02 23:41:32 user nova-compute[72520]: iface.initiatorname = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.state = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.vlan_id = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.vlan_priority = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.vlan_state = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.iface_num = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.mtu = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.port = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.bootproto = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.subnet_mask = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.gateway = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_alt_client_id_state = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_alt_client_id = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_dns = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_learn_iqn = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_req_vendor_id_state = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_vendor_id_state = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_vendor_id = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.dhcp_slp_da = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.fragmentation = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.gratuitous_arp = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.incoming_forwarding = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.tos_state = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.tos = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.ttl = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.delayed_ack = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.tcp_nagle = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.tcp_wsf_state = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.tcp_wsf = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.tcp_timer_scale = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.tcp_timestamp = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.redirect = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.def_task_mgmt_timeout = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.header_digest = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.data_digest = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.immediate_data = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.initial_r2t = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.data_seq_inorder = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.data_pdu_inorder = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.erl = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.max_receive_data_len = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.first_burst_len = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.max_outstanding_r2t = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.max_burst_len = 0
Aug 02 23:41:32 user nova-compute[72520]: iface.chap_auth = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.bidi_chap = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.strict_login_compliance = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.discovery_auth = <empty>
Aug 02 23:41:32 user nova-compute[72520]: iface.discovery_logout = <empty>
Aug 02 23:41:32 user nova-compute[72520]: node.discovery_address = <empty>
Aug 02 23:41:32 user nova-compute[72520]: node.discovery_port = 0
Aug 02 23:41:32 user nova-compute[72520]: node.discovery_type = static
Aug 02 23:41:32 user nova-compute[72520]: node.session.initial_cmdsn = 0
Aug 02 23:41:32 user nova-compute[72520]: node.session.initial_login_retry_max = 8
Aug 02 23:41:32 user nova-compute[72520]: node.session.xmit_thread_priority = -20
Aug 02 23:41:32 user nova-compute[72520]: node.session.cmds_max = 128
Aug 02 23:41:32 user nova-compute[72520]: node.session.queue_depth = 32
Aug 02 23:41:32 user nova-compute[72520]: node.session.nr_sessions = 1
Aug 02 23:41:32 user nova-compute[72520]: node.session.auth.authmethod = CHAP
Aug 02 23:41:32 user nova-compute[72520]: node.session.auth.username = OhblzHmW
Aug 02 23:41:32 user nova-compute[72520]: node.session.auth.password = ***
Aug 02 23:41:32 user nova-compute[72520]: node.session.auth.username_in = <empty>
Aug 02 23:41:32 user nova-compute[72520]: node.session.auth.password_in = <empty>
Aug 02 23:41:32 user nova-compute[72520]: node.session.auth.chap_algs = MD5
Aug 02 23:41:32 user nova-compute[72520]: node.session.timeo.replacement_timeout = 120
Aug 02 23:41:32 user nova-compute[72520]: node.session.err_timeo.abort_timeout = 15
Aug 02 23:41:32 user nova-compute[72520]: node.session.err_timeo.lu_reset_timeout = 30
Aug 02 23:41:32 user nova-compute[72520]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 02 23:41:32 user nova-compute[72520]: node.session.err_timeo.host_reset_timeout = 60
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.FastAbort = Yes
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.InitialR2T = No
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.ImmediateData = Yes
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.FirstBurstLength = 262144
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.MaxBurstLength = 16776192
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.DefaultTime2Retain = 0
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.DefaultTime2Wait = 2
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.MaxConnections = 1
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 02 23:41:32 user nova-compute[72520]: node.session.iscsi.ERL = 0
Aug 02 23:41:32 user nova-compute[72520]: node.session.scan = manual
Aug 02 23:41:32 user nova-compute[72520]: node.session.reopen_max = 0
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].address = 172.16.0.220
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].port = 3260
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].startup = manual
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].tcp.window_size = 524288
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].tcp.type_of_service = 0
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].timeo.logout_timeout = 15
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].timeo.login_timeout = 15
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].timeo.auth_timeout = 45
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].timeo.noop_out_interval = 5
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].timeo.noop_out_timeout = 5
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].iscsi.HeaderDigest = None
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].iscsi.DataDigest = None
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].iscsi.IFMarker = No
Aug 02 23:41:32 user nova-compute[72520]: node.conn[0].iscsi.OFMarker = No
Aug 02 23:41:32 user nova-compute[72520]: # END RECORD
Aug 02 23:41:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2d3ff-32e6-4caf-b7fa-5915b253892b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2136ae02-a123-4050-9939-1341f4f89b83]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhblzHmW {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhblzHmW" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7306e596-aede-41e1-b9d0-bc18fae91607]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OhblzHmW'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe699c7a-1d9d-467c-be64-0f6ca5064c08]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcba1dc-6479-4387-a54c-c33c21e32ef4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] HCTL ('34', '0', '0', 0) found on session 26 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21432c4-d5a8-4ab4-8131-6aa16dc4585a]: (4, ('0 0 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching for a device in session 26 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhblzHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '23233663538623363', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233663538623363', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750341404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750341404',id=23,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:39:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-w70ajkgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:39:58Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=fb121921-3b3c-43dc-ad9a-8aa1d5c49301,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "vif_mac": "fa:16:3e:6d:db:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "vif_mac": "fa:16:3e:6d:db:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'pci_devices' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:41:32 user nova-compute[72520]:   <uuid>fb121921-3b3c-43dc-ad9a-8aa1d5c49301</uuid>
Aug 02 23:41:32 user nova-compute[72520]:   <name>instance-00000017</name>
Aug 02 23:41:32 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:41:32 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:41:32 user nova-compute[72520]:   <metadata>
Aug 02 23:41:32 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:41:32 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:41:32 user nova-compute[72520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-750341404</nova:name>
Aug 02 23:41:32 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:41:32</nova:creationTime>
Aug 02 23:41:32 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:41:32 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:41:32 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:41:32 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:41:32 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:41:32 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:41:32 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:41:32 user nova-compute[72520]:       <nova:owner>
Aug 02 23:41:32 user nova-compute[72520]:         <nova:user uuid="f3ecb56ac3554ee3b1ef658d9cdd3869">tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member</nova:user>
Aug 02 23:41:32 user nova-compute[72520]:         <nova:project uuid="542e5ab2d59245f58d357cf688e30a43">tempest-ServerBootFromVolumeStableRescueTest-1108272558</nova:project>
Aug 02 23:41:32 user nova-compute[72520]:       </nova:owner>
Aug 02 23:41:32 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:41:32 user nova-compute[72520]:       <nova:ports>
Aug 02 23:41:32 user nova-compute[72520]:         <nova:port uuid="bdea32db-5527-45e2-a8ea-970fd468288c">
Aug 02 23:41:32 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 02 23:41:32 user nova-compute[72520]:         </nova:port>
Aug 02 23:41:32 user nova-compute[72520]:       </nova:ports>
Aug 02 23:41:32 user nova-compute[72520]:     </nova:instance>
Aug 02 23:41:32 user nova-compute[72520]:   </metadata>
Aug 02 23:41:32 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:41:32 user nova-compute[72520]:     <system>
Aug 02 23:41:32 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:41:32 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:41:32 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:41:32 user nova-compute[72520]:       <entry name="serial">fb121921-3b3c-43dc-ad9a-8aa1d5c49301</entry>
Aug 02 23:41:32 user nova-compute[72520]:       <entry name="uuid">fb121921-3b3c-43dc-ad9a-8aa1d5c49301</entry>
Aug 02 23:41:32 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:41:32 user nova-compute[72520]:     </system>
Aug 02 23:41:32 user nova-compute[72520]:   </sysinfo>
Aug 02 23:41:32 user nova-compute[72520]:   <os>
Aug 02 23:41:32 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:41:32 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:41:32 user nova-compute[72520]:   </os>
Aug 02 23:41:32 user nova-compute[72520]:   <features>
Aug 02 23:41:32 user nova-compute[72520]:     <acpi/>
Aug 02 23:41:32 user nova-compute[72520]:     <apic/>
Aug 02 23:41:32 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:41:32 user nova-compute[72520]:   </features>
Aug 02 23:41:32 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:41:32 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:41:32 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:41:32 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:41:32 user nova-compute[72520]:   </clock>
Aug 02 23:41:32 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:41:32 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:41:32 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:41:32 user nova-compute[72520]:   </cpu>
Aug 02 23:41:32 user nova-compute[72520]:   <devices>
Aug 02 23:41:32 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:41:32 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:41:32 user nova-compute[72520]:       <source dev="/dev/sdc"/>
Aug 02 23:41:32 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:41:32 user nova-compute[72520]:       <serial>9e9cd575-25cd-4159-8f5f-e28e8af973a7</serial>
Aug 02 23:41:32 user nova-compute[72520]:     </disk>
Aug 02 23:41:32 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:41:32 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:41:32 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue"/>
Aug 02 23:41:32 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:41:32 user nova-compute[72520]:       <boot order="1"/>
Aug 02 23:41:32 user nova-compute[72520]:     </disk>
Aug 02 23:41:32 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:41:32 user nova-compute[72520]:       <mac address="fa:16:3e:6d:db:2a"/>
Aug 02 23:41:32 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:41:32 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:41:32 user nova-compute[72520]:       <target dev="tapbdea32db-55"/>
Aug 02 23:41:32 user nova-compute[72520]:     </interface>
Aug 02 23:41:32 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:41:32 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/console.log" append="off"/>
Aug 02 23:41:32 user nova-compute[72520]:     </serial>
Aug 02 23:41:32 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:41:32 user nova-compute[72520]:     <video>
Aug 02 23:41:32 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:41:32 user nova-compute[72520]:     </video>
Aug 02 23:41:32 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:41:32 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:41:32 user nova-compute[72520]:     </rng>
Aug 02 23:41:32 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:41:32 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:41:32 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:41:32 user nova-compute[72520]:     </memballoon>
Aug 02 23:41:32 user nova-compute[72520]:   </devices>
Aug 02 23:41:32 user nova-compute[72520]: </domain>
Aug 02 23:41:32 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:41:32 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance destroyed successfully.
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:41:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No VIF found with MAC fa:16:3e:6d:db:2a, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:41:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-b09e1985-dee7-4896-b009-d8a745266dc9 req-13e751b9-ecf9-42a1-b129-5f922f958631 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b09e1985-dee7-4896-b009-d8a745266dc9 req-13e751b9-ecf9-42a1-b129-5f922f958631 service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b09e1985-dee7-4896-b009-d8a745266dc9 req-13e751b9-ecf9-42a1-b129-5f922f958631 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b09e1985-dee7-4896-b009-d8a745266dc9 req-13e751b9-ecf9-42a1-b129-5f922f958631 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-b09e1985-dee7-4896-b009-d8a745266dc9 req-13e751b9-ecf9-42a1-b129-5f922f958631 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:34 user nova-compute[72520]: WARNING nova.compute.manager [req-b09e1985-dee7-4896-b009-d8a745266dc9 req-13e751b9-ecf9-42a1-b129-5f922f958631 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state active and task_state rescuing.
Aug 02 23:41:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-f8fc52ce-d77b-4900-9e7d-8f0b44bf1bf9 req-95cdebbf-c75f-4337-8dd7-cd97a43621ad service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f8fc52ce-d77b-4900-9e7d-8f0b44bf1bf9 req-95cdebbf-c75f-4337-8dd7-cd97a43621ad service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f8fc52ce-d77b-4900-9e7d-8f0b44bf1bf9 req-95cdebbf-c75f-4337-8dd7-cd97a43621ad service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f8fc52ce-d77b-4900-9e7d-8f0b44bf1bf9 req-95cdebbf-c75f-4337-8dd7-cd97a43621ad service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-f8fc52ce-d77b-4900-9e7d-8f0b44bf1bf9 req-95cdebbf-c75f-4337-8dd7-cd97a43621ad service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:36 user nova-compute[72520]: WARNING nova.compute.manager [req-f8fc52ce-d77b-4900-9e7d-8f0b44bf1bf9 req-95cdebbf-c75f-4337-8dd7-cd97a43621ad service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state active and task_state rescuing.
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for fb121921-3b3c-43dc-ad9a-8aa1d5c49301 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019696.6912549, fb121921-3b3c-43dc-ad9a-8aa1d5c49301 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:41:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] VM Resumed (Lifecycle Event)
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5f00f03f-bae3-46c0-bbc1-f0f11b79684a tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:41:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019696.693058, fb121921-3b3c-43dc-ad9a-8aa1d5c49301 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:41:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] VM Started (Lifecycle Event)
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:41:37 user nova-compute[72520]: INFO nova.compute.claims [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Claim successful on node user
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:41:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.policy [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9f79446d734cbfa7644b128bbf5275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9052da981a9a4629b46fb0d3533c96c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:41:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Creating image(s)
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "/opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.171s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.162s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk 1073741824" returned: 0 in 0.057s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Successfully created port: a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Cannot resize image /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'migration_context' on Instance uuid 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Ensure instance console log exists: /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Successfully updated port: a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquired lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-changed-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Refreshing instance network info cache due to event network-changed-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] Acquiring lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Updating instance_info_cache with network_info: [{"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Releasing lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Instance network_info: |[{"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] Acquired lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Refreshing network info cache for port a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Start _get_guest_xml network_info=[{"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:41:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1978714043',display_name='tempest-AttachVolumeNegativeTest-server-1978714043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1978714043',id=24,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZNU27nOdvfE4WKtIl4YzfdziX0Wn6i9Shb8wo1vcBQcMMTUqi413bkyL8VsMP9ssX1/QOoIOnNkB5W3JwG6CbNu+CqMSyIjbMXEDkuYhxBsXkQUFNhUv+IQC2tCpopPQ==',key_name='tempest-keypair-543522041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-qz36xf2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=2d82b6da-b401-4326-bfef-6e9a5e4f9bb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=a416bd60-1ce5-4b6b-b4c9-f530f63d0a42,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa416bd60-1c') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:41:39 user nova-compute[72520]:   <uuid>2d82b6da-b401-4326-bfef-6e9a5e4f9bb4</uuid>
Aug 02 23:41:39 user nova-compute[72520]:   <name>instance-00000018</name>
Aug 02 23:41:39 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:41:39 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:41:39 user nova-compute[72520]:   <metadata>
Aug 02 23:41:39 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:41:39 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:41:39 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1978714043</nova:name>
Aug 02 23:41:39 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:41:39</nova:creationTime>
Aug 02 23:41:39 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:41:39 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:41:39 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:41:39 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:41:39 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:41:39 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:41:39 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:41:39 user nova-compute[72520]:       <nova:owner>
Aug 02 23:41:39 user nova-compute[72520]:         <nova:user uuid="eb9f79446d734cbfa7644b128bbf5275">tempest-AttachVolumeNegativeTest-1376380752-project-member</nova:user>
Aug 02 23:41:39 user nova-compute[72520]:         <nova:project uuid="9052da981a9a4629b46fb0d3533c96c7">tempest-AttachVolumeNegativeTest-1376380752</nova:project>
Aug 02 23:41:39 user nova-compute[72520]:       </nova:owner>
Aug 02 23:41:39 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:41:39 user nova-compute[72520]:       <nova:ports>
Aug 02 23:41:39 user nova-compute[72520]:         <nova:port uuid="a416bd60-1ce5-4b6b-b4c9-f530f63d0a42">
Aug 02 23:41:39 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 02 23:41:39 user nova-compute[72520]:         </nova:port>
Aug 02 23:41:39 user nova-compute[72520]:       </nova:ports>
Aug 02 23:41:39 user nova-compute[72520]:     </nova:instance>
Aug 02 23:41:39 user nova-compute[72520]:   </metadata>
Aug 02 23:41:39 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:41:39 user nova-compute[72520]:     <system>
Aug 02 23:41:39 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:41:39 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:41:39 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:41:39 user nova-compute[72520]:       <entry name="serial">2d82b6da-b401-4326-bfef-6e9a5e4f9bb4</entry>
Aug 02 23:41:39 user nova-compute[72520]:       <entry name="uuid">2d82b6da-b401-4326-bfef-6e9a5e4f9bb4</entry>
Aug 02 23:41:39 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:41:39 user nova-compute[72520]:     </system>
Aug 02 23:41:39 user nova-compute[72520]:   </sysinfo>
Aug 02 23:41:39 user nova-compute[72520]:   <os>
Aug 02 23:41:39 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:41:39 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:41:39 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:41:39 user nova-compute[72520]:   </os>
Aug 02 23:41:39 user nova-compute[72520]:   <features>
Aug 02 23:41:39 user nova-compute[72520]:     <acpi/>
Aug 02 23:41:39 user nova-compute[72520]:     <apic/>
Aug 02 23:41:39 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:41:39 user nova-compute[72520]:   </features>
Aug 02 23:41:39 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:41:39 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:41:39 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:41:39 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:41:39 user nova-compute[72520]:   </clock>
Aug 02 23:41:39 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:41:39 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:41:39 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:41:39 user nova-compute[72520]:   </cpu>
Aug 02 23:41:39 user nova-compute[72520]:   <devices>
Aug 02 23:41:39 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:41:39 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:41:39 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk"/>
Aug 02 23:41:39 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:41:39 user nova-compute[72520]:     </disk>
Aug 02 23:41:39 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:41:39 user nova-compute[72520]:       <mac address="fa:16:3e:0e:cc:95"/>
Aug 02 23:41:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:41:39 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:41:39 user nova-compute[72520]:       <target dev="tapa416bd60-1c"/>
Aug 02 23:41:39 user nova-compute[72520]:     </interface>
Aug 02 23:41:39 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:41:39 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/console.log" append="off"/>
Aug 02 23:41:39 user nova-compute[72520]:     </serial>
Aug 02 23:41:39 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:41:39 user nova-compute[72520]:     <video>
Aug 02 23:41:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:41:39 user nova-compute[72520]:     </video>
Aug 02 23:41:39 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:41:39 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:41:39 user nova-compute[72520]:     </rng>
Aug 02 23:41:39 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:41:39 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:41:39 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:41:39 user nova-compute[72520]:     </memballoon>
Aug 02 23:41:39 user nova-compute[72520]:   </devices>
Aug 02 23:41:39 user nova-compute[72520]: </domain>
Aug 02 23:41:39 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1978714043',display_name='tempest-AttachVolumeNegativeTest-server-1978714043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1978714043',id=24,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZNU27nOdvfE4WKtIl4YzfdziX0Wn6i9Shb8wo1vcBQcMMTUqi413bkyL8VsMP9ssX1/QOoIOnNkB5W3JwG6CbNu+CqMSyIjbMXEDkuYhxBsXkQUFNhUv+IQC2tCpopPQ==',key_name='tempest-keypair-543522041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-qz36xf2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=2d82b6da-b401-4326-bfef-6e9a5e4f9bb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=a416bd60-1ce5-4b6b-b4c9-f530f63d0a42,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa416bd60-1c') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_vif [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=a416bd60-1ce5-4b6b-b4c9-f530f63d0a42,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa416bd60-1c') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa416bd60-1c, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa416bd60-1c, col_values=(('external_ids', {'iface-id': 'a416bd60-1ce5-4b6b-b4c9-f530f63d0a42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:cc:95', 'vm-uuid': '2d82b6da-b401-4326-bfef-6e9a5e4f9bb4'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:40 user nova-compute[72520]: INFO os_vif [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=a416bd60-1ce5-4b6b-b4c9-f530f63d0a42,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa416bd60-1c')
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No VIF found with MAC fa:16:3e:0e:cc:95, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Updated VIF entry in instance network info cache for port a416bd60-1ce5-4b6b-b4c9-f530f63d0a42. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Updating instance_info_cache with network_info: [{"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-733fb388-a616-4f10-bdc5-b9a5da32955a req-59d328c5-488a-4090-b07d-ccb356b0b032 service nova] Releasing lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caCBAtEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:41:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:41:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:41:40 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11aa254-ead3-442d-ba05-b60dca61c054]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:41:40 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c56cf44-8752-4aad-8622-6059dd98fb89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c] added
Aug 02 23:41:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea19572-7207-402c-99bc-9e7e4bd322e9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7819d33c-f4de-4426-a1ef-ea7d6f0a0d3a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v caCBAtEp {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v caCBAtEp" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921cec4-f930-4f56-8cb9-cf3f1e79f084]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'caCBAtEp'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0514f8-7e3e-47ba-9ea5-5eec682607f0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10eb36-1544-4550-9173-c7c9e3de4540]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d658db1-69c8-4af0-94c2-db21339544bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260]
Aug 02 23:41:40 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260] successful.
Aug 02 23:41:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f0ce7-e6f3-4d11-8912-afd63572185d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d30a7-5e12-4475-a29a-f59a997bcfd9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:40 user nova-compute[72520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c (non-flash)
Aug 02 23:41:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:40 user nova-compute[72520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c (non-flash)
Aug 02 23:41:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b463f5-8e9c-4f4c-9e3b-f8366e899d7f]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:41:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caCBAtEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-2bfe078d-786e-4890-8356-cf41bfd37128 req-10bcf819-c457-4ab3-a1b6-86b839c7c4c1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2bfe078d-786e-4890-8356-cf41bfd37128 req-10bcf819-c457-4ab3-a1b6-86b839c7c4c1 service nova] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2bfe078d-786e-4890-8356-cf41bfd37128 req-10bcf819-c457-4ab3-a1b6-86b839c7c4c1 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2bfe078d-786e-4890-8356-cf41bfd37128 req-10bcf819-c457-4ab3-a1b6-86b839c7c4c1 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-2bfe078d-786e-4890-8356-cf41bfd37128 req-10bcf819-c457-4ab3-a1b6-86b839c7c4c1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] No waiting events found dispatching network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:41 user nova-compute[72520]: WARNING nova.compute.manager [req-2bfe078d-786e-4890-8356-cf41bfd37128 req-10bcf819-c457-4ab3-a1b6-86b839c7c4c1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received unexpected event network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 for instance with vm_state building and task_state spawning.
Aug 02 23:41:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23338663864646662', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338663864646662', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG nova.objects.instance [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lazy-loading 'flavor' on Instance uuid bdf4e227-f9cb-4cee-b9ef-c649ca597031 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:41:41 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:41:41 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:41:41 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:41:41 user nova-compute[72520]:   <serial>bbd4a47c-e789-4ac8-8f4c-2801462c719c</serial>
Aug 02 23:41:41 user nova-compute[72520]: </disk>
Aug 02 23:41:41 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] No VIF found with MAC fa:16:3e:28:80:6f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:41:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-978220e6-c021-4f98-8483-397769e44f64 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.387s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-65ec601f-b790-4abd-aa80-9d8462ddacd8 req-cf3bfe3a-95b2-46e0-a1c1-4d63a9086a42 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-65ec601f-b790-4abd-aa80-9d8462ddacd8 req-cf3bfe3a-95b2-46e0-a1c1-4d63a9086a42 service nova] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-65ec601f-b790-4abd-aa80-9d8462ddacd8 req-cf3bfe3a-95b2-46e0-a1c1-4d63a9086a42 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-65ec601f-b790-4abd-aa80-9d8462ddacd8 req-cf3bfe3a-95b2-46e0-a1c1-4d63a9086a42 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-65ec601f-b790-4abd-aa80-9d8462ddacd8 req-cf3bfe3a-95b2-46e0-a1c1-4d63a9086a42 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] No waiting events found dispatching network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:43 user nova-compute[72520]: WARNING nova.compute.manager [req-65ec601f-b790-4abd-aa80-9d8462ddacd8 req-cf3bfe3a-95b2-46e0-a1c1-4d63a9086a42 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received unexpected event network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 for instance with vm_state building and task_state spawning.
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019703.8164034, 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:41:43 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] VM Resumed (Lifecycle Event)
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:41:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Instance spawned successfully.
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:41:43 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019703.8245, 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:41:43 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] VM Started (Lifecycle Event)
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:41:43 user nova-compute[72520]: INFO nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 02 23:41:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:41:43 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:41:44 user nova-compute[72520]: INFO nova.compute.manager [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Took 6.75 seconds to build instance.
Aug 02 23:41:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b623a6c-f1a0-4bd9-8b06-c81bd247cdb2 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.860s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:44 user nova-compute[72520]: INFO nova.compute.manager [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Detaching volume bbd4a47c-e789-4ac8-8f4c-2801462c719c
Aug 02 23:41:44 user nova-compute[72520]: INFO nova.virt.block_device [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Attempting to driver detach volume bbd4a47c-e789-4ac8-8f4c-2801462c719c from mountpoint /dev/vdb
Aug 02 23:41:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Attempting to detach device vdb from instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:41:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:41:44 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:41:44 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:41:44 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:41:44 user nova-compute[72520]:   <serial>bbd4a47c-e789-4ac8-8f4c-2801462c719c</serial>
Aug 02 23:41:44 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:41:44 user nova-compute[72520]: </disk>
Aug 02 23:41:44 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:41:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Successfully detached device vdb from instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 from the persistent domain config.
Aug 02 23:41:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:41:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:41:44 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:41:44 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:41:44 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:41:44 user nova-compute[72520]:   <serial>bbd4a47c-e789-4ac8-8f4c-2801462c719c</serial>
Aug 02 23:41:44 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:41:44 user nova-compute[72520]: </disk>
Aug 02 23:41:44 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019705.336283, bdf4e227-f9cb-4cee-b9ef-c649ca597031 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:41:45 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Successfully detached device vdb from instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 from the live domain config.
Aug 02 23:41:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caCBAtEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:41:45 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17585464-0489-410c-922e-d8eeeafb6082]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc9fae-9127-4d3a-9497-117839377c6f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:45 user nova-compute[72520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c (non-flash)
Aug 02 23:41:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:41:45 user nova-compute[72520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c (non-flash)
Aug 02 23:41:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d0a6a7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c194b2c-23f3-4822-94c8-1d2a6511f2c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[635f19ea-e44d-43f7-82c9-ead7c5fc7d2c]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320fe3f-f65e-4d42-98d3-39973a530eba]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256fe8c-c094-4caf-b741-a0451c6905e4]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cca9290-f4a2-43b7-8d51-ca576da164d4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b3dc7-c7db-4f5e-a9ca-43594335a1c7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260]
Aug 02 23:41:45 user nova-compute[72520]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c, portal: 172.16.0.220,3260] successful.
Aug 02 23:41:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbd4a47c-e789-4ac8-8f4c-2801462c719c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dcbf38-718c-467f-876b-ad74cbb4b653]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] <== disconnect_volume: return (296ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:41:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG nova.objects.instance [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lazy-loading 'flavor' on Instance uuid bdf4e227-f9cb-4cee-b9ef-c649ca597031 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-44cc6a97-6ac0-48c8-907c-779fcca30111 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.007s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating instance_info_cache with network_info: [{"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-f0f48878-9b8a-4078-8e7b-763b1331d037" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:41:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:41:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:49 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 02 23:41:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:41:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:41:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=25.42043685913086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f0f48878-9b8a-4078-8e7b-763b1331d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance bdf4e227-f9cb-4cee-b9ef-c649ca597031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:41:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:41:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:41:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 02 23:41:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:58 user nova-compute[72520]: INFO nova.compute.manager [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Terminating instance
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-913b77a8-c7e5-4711-828d-14cc9c0ab1c3 req-fd605a1a-d39a-4ec9-9c9a-d397fdb4b1bc service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-vif-unplugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-913b77a8-c7e5-4711-828d-14cc9c0ab1c3 req-fd605a1a-d39a-4ec9-9c9a-d397fdb4b1bc service nova] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-913b77a8-c7e5-4711-828d-14cc9c0ab1c3 req-fd605a1a-d39a-4ec9-9c9a-d397fdb4b1bc service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-913b77a8-c7e5-4711-828d-14cc9c0ab1c3 req-fd605a1a-d39a-4ec9-9c9a-d397fdb4b1bc service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-913b77a8-c7e5-4711-828d-14cc9c0ab1c3 req-fd605a1a-d39a-4ec9-9c9a-d397fdb4b1bc service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] No waiting events found dispatching network-vif-unplugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-913b77a8-c7e5-4711-828d-14cc9c0ab1c3 req-fd605a1a-d39a-4ec9-9c9a-d397fdb4b1bc service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-vif-unplugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Instance destroyed successfully.
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.objects.instance [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lazy-loading 'resources' on Instance uuid f0f48878-9b8a-4078-8e7b-763b1331d037 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1978334357',display_name='tempest-SnapshotDataIntegrityTests-server-1978334357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1978334357',id=14,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH1zkACakvTIP3tN43qW5QqT2qoPSXKg/mLELsBTboXah2LWD4863hs8AJashcOYPaaohGSQElF61aKdwwddSJI4skDSRuWF6VoDv1rD1zgNyfjey5+W0YMS7ctgUvgFQ==',key_name='tempest-keypair-1601786538',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:34:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d0eccad94f3476680dbb44bc77656e4',ramdisk_id='',reservation_id='r-7tsmr0vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1070468552',owner_user_name='tempest-SnapshotDataIntegrityTests-1070468552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f0fc0765614221bc3599360bff975e',uuid=f0f48878-9b8a-4078-8e7b-763b1331d037,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Converting VIF {"id": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "address": "fa:16:3e:98:7d:b0", "network": {"id": "2b3eba0b-7ef4-4722-9605-7e45d257a28c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802319411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d0eccad94f3476680dbb44bc77656e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6621ff4-2e", "ovs_interfaceid": "e6621ff4-2e1e-4c89-877e-a05152ee45aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e6621ff4-2e1e-4c89-877e-a05152ee45aa,network=Network(2b3eba0b-7ef4-4722-9605-7e45d257a28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6621ff4-2e') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG os_vif [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e6621ff4-2e1e-4c89-877e-a05152ee45aa,network=Network(2b3eba0b-7ef4-4722-9605-7e45d257a28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6621ff4-2e') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6621ff4-2e, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:58 user nova-compute[72520]: INFO os_vif [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e6621ff4-2e1e-4c89-877e-a05152ee45aa,network=Network(2b3eba0b-7ef4-4722-9605-7e45d257a28c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6621ff4-2e')
Aug 02 23:41:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Deleting instance files /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037_del
Aug 02 23:41:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Deletion of /opt/stack/data/nova/instances/f0f48878-9b8a-4078-8e7b-763b1331d037_del complete
Aug 02 23:41:59 user nova-compute[72520]: INFO nova.compute.manager [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 02 23:41:59 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:41:59 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:41:59 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:41:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:41:59 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:59 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Took 0.83 seconds to deallocate network for instance.
Aug 02 23:41:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-0f6361bb-6033-43c7-9f31-83417ca762e6 req-01fc75e6-8b09-4f91-85b2-49967bdde1f2 service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-vif-deleted-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:41:59 user nova-compute[72520]: INFO nova.compute.manager [req-0f6361bb-6033-43c7-9f31-83417ca762e6 req-01fc75e6-8b09-4f91-85b2-49967bdde1f2 service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Neutron deleted interface e6621ff4-2e1e-4c89-877e-a05152ee45aa; detaching it from the instance and deleting it from the info cache
Aug 02 23:41:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-0f6361bb-6033-43c7-9f31-83417ca762e6 req-01fc75e6-8b09-4f91-85b2-49967bdde1f2 service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:41:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-0f6361bb-6033-43c7-9f31-83417ca762e6 req-01fc75e6-8b09-4f91-85b2-49967bdde1f2 service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Detach interface failed, port_id=e6621ff4-2e1e-4c89-877e-a05152ee45aa, reason: Instance f0f48878-9b8a-4078-8e7b-763b1331d037 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:41:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:41:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:00 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Deleted allocations for instance f0f48878-9b8a-4078-8e7b-763b1331d037
Aug 02 23:42:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-464522af-8ae9-4aaf-9392-266bebd8377a tempest-SnapshotDataIntegrityTests-1070468552 tempest-SnapshotDataIntegrityTests-1070468552-project-member] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-e9b38f55-a55d-494e-8297-880c4da3bb66 req-532593c4-3fc3-42aa-824a-05c0173eed0b service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received event network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e9b38f55-a55d-494e-8297-880c4da3bb66 req-532593c4-3fc3-42aa-824a-05c0173eed0b service nova] Acquiring lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e9b38f55-a55d-494e-8297-880c4da3bb66 req-532593c4-3fc3-42aa-824a-05c0173eed0b service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e9b38f55-a55d-494e-8297-880c4da3bb66 req-532593c4-3fc3-42aa-824a-05c0173eed0b service nova] Lock "f0f48878-9b8a-4078-8e7b-763b1331d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-e9b38f55-a55d-494e-8297-880c4da3bb66 req-532593c4-3fc3-42aa-824a-05c0173eed0b service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] No waiting events found dispatching network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:00 user nova-compute[72520]: WARNING nova.compute.manager [req-e9b38f55-a55d-494e-8297-880c4da3bb66 req-532593c4-3fc3-42aa-824a-05c0173eed0b service nova] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Received unexpected event network-vif-plugged-e6621ff4-2e1e-4c89-877e-a05152ee45aa for instance with vm_state deleted and task_state None.
Aug 02 23:42:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'flavor' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:06 user nova-compute[72520]: INFO nova.compute.manager [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Attaching volume a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 to /dev/vdb
Aug 02 23:42:06 user nova-compute[72520]: DEBUG os_brick.utils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa7c4a-af31-4fd7-b011-9d0482b4db4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f0e83-d548-4188-bf36-585449e8647f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a00cbc1-fc21-4ffc-a369-a68f54fe3b8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5907c6ff-1688-44e6-9307-b46eac1bb8c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:42:06 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:42:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79325b7b-6681-4038-a3ed-25cd7f443ad1]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG os_brick.utils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:06 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating existing volume attachment record: a29f577a-97b2-4690-be64-33b9d89545f5 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:42:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:13 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019718.9637587, f0f48878-9b8a-4078-8e7b-763b1331d037 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:42:13 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] VM Stopped (Lifecycle Event)
Aug 02 23:42:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6e149735-aedd-419c-a229-7fee29bde88d None None] [instance: f0f48878-9b8a-4078-8e7b-763b1331d037] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:14 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:14 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:14 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc4997-7df3-477d-8498-7236af8155b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:42:14 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff80ead-2ae0-42bc-bf4b-c708b009f4e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5] added
Aug 02 23:42:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee5983-f6bf-4a24-8fe8-7239fa4c6b5e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d326d290-8d2b-45ba-8470-7897e1d2616f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scUhPfMT {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scUhPfMT" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36853fec-b3da-449e-8a5b-69da00444107]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scUhPfMT'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddea0b4d-ceb3-47a2-b3d4-c00b483adca1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[82185e6e-6670-46a9-8b09-45492774e0a1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbff3dd-3921-4c41-9f19-e0e89b045525]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]
Aug 02 23:42:14 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.
Aug 02 23:42:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f03a338-b0cc-4793-b76f-c517776624d1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[959264f4-d5e7-4b4b-ae8e-ef47fca15efc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:14 user nova-compute[72520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:14 user nova-compute[72520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[be00ebf9-0129-4c87-9c5c-63f1253c6b54]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23837346237663165', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837346237663165', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'flavor' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:42:15 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:42:15 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:42:15 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:42:15 user nova-compute[72520]:   <serial>a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5</serial>
Aug 02 23:42:15 user nova-compute[72520]: </disk>
Aug 02 23:42:15 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No VIF found with MAC fa:16:3e:4a:23:f6, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:42:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5a7528c-a080-4a0e-9ba1-be0ca02757d6 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.313s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:17 user nova-compute[72520]: INFO nova.compute.manager [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Rebuilding instance
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'pci_requests' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'resources' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'migration_context' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-629bf940-192f-46fa-93f7-01678528b8d6 req-966679f7-2517-4066-8c54-841fea7625e3 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-unplugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-629bf940-192f-46fa-93f7-01678528b8d6 req-966679f7-2517-4066-8c54-841fea7625e3 service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-629bf940-192f-46fa-93f7-01678528b8d6 req-966679f7-2517-4066-8c54-841fea7625e3 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-629bf940-192f-46fa-93f7-01678528b8d6 req-966679f7-2517-4066-8c54-841fea7625e3 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-629bf940-192f-46fa-93f7-01678528b8d6 req-966679f7-2517-4066-8c54-841fea7625e3 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-unplugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:17 user nova-compute[72520]: WARNING nova.compute.manager [req-629bf940-192f-46fa-93f7-01678528b8d6 req-966679f7-2517-4066-8c54-841fea7625e3 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received unexpected event network-vif-unplugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with vm_state active and task_state rebuilding.
Aug 02 23:42:18 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance destroyed successfully.
Aug 02 23:42:18 user nova-compute[72520]: INFO nova.compute.manager [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Detaching volume a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5
Aug 02 23:42:18 user nova-compute[72520]: INFO nova.virt.block_device [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Attempting to driver detach volume a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 from mountpoint /dev/vdb
Aug 02 23:42:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Attempting to detach device vdb from instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:42:18 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:42:18 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:42:18 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:42:18 user nova-compute[72520]:   <serial>a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5</serial>
Aug 02 23:42:18 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:42:18 user nova-compute[72520]: </disk>
Aug 02 23:42:18 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:42:18 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully detached device vdb from instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac from the persistent domain config.
Aug 02 23:42:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:18 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf01d2b5-3fbd-4e13-bd3a-dbcb05954792]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c44c472-790b-4a63-ad24-9c1dc01a29cc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:18 user nova-compute[72520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:18 user nova-compute[72520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce460d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e964f0c-066f-48ae-9cd1-615f9bdb6744]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2e9b8a-af5c-4faf-b17a-f6b48da5e807]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[567ecb6c-f33e-495a-9b8a-def4da1c0504]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15404bbe-2e80-4c95-846d-67ea621dad1d]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd20a72-e5d0-4a96-9654-73a8b8f48252]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d3b76-d267-43e4-af5c-3ded89043791]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]
Aug 02 23:42:18 user nova-compute[72520]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.
Aug 02 23:42:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f3923-e9ef-46e6-928b-adb4839d487b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== disconnect_volume: return (277ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:42:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:19 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance destroyed successfully.
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1926157642',display_name='tempest-ServerActionsTestOtherA-server-1536478268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1926157642',id=20,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-8ioinyiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=6ca3c320-bf1c-43b5-973c-4d73b22487ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_vif [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad1bea50-6d, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:19 user nova-compute[72520]: INFO os_vif [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d')
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5cdfb7-f5eb-4c87-af90-34632ab89993]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e7197e-eeee-4fe0-84ad-40f8f6da04ad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4276ef0>, {}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Disconnecting from: [] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== disconnect_volume: return (52ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:42:19 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Deleting instance files /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac_del
Aug 02 23:42:19 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Deletion of /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac_del complete
Aug 02 23:42:19 user nova-compute[72520]: INFO nova.virt.block_device [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Booting with volume a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 at /dev/vdb
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.utils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[952026dc-949c-4d80-b29b-a6cb5327f273]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-2b5812fb-a021-4679-9247-d791ffcda9b0 req-bd05cf41-497e-447d-aba8-5c4dccb6d321 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2b5812fb-a021-4679-9247-d791ffcda9b0 req-bd05cf41-497e-447d-aba8-5c4dccb6d321 service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2b5812fb-a021-4679-9247-d791ffcda9b0 req-bd05cf41-497e-447d-aba8-5c4dccb6d321 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2b5812fb-a021-4679-9247-d791ffcda9b0 req-bd05cf41-497e-447d-aba8-5c4dccb6d321 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-2b5812fb-a021-4679-9247-d791ffcda9b0 req-bd05cf41-497e-447d-aba8-5c4dccb6d321 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:19 user nova-compute[72520]: WARNING nova.compute.manager [req-2b5812fb-a021-4679-9247-d791ffcda9b0 req-bd05cf41-497e-447d-aba8-5c4dccb6d321 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received unexpected event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc9df9-ec12-4517-8cf8-54b6d6ecfa6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[20730960-41ea-43d6-b276-13667a764e56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691effd-2d25-4a5a-9c73-721d2f8fa71e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:42:19 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:42:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8cab5-1b03-450f-8005-40bd5dc06db6]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG os_brick.utils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:19 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating existing volume attachment record: 6dc6a804-bd48-4a35-93be-353331a2301c {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'flavor' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:24 user nova-compute[72520]: INFO nova.compute.manager [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Attaching volume bcd70029-053c-4e74-a20b-7d41eccdebfa to /dev/vdb
Aug 02 23:42:24 user nova-compute[72520]: DEBUG os_brick.utils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[314de277-9166-4db9-972e-56d23d29efe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c56e8e-9424-4fcf-ba47-712d7a73bd37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[acac9903-0972-4935-a4a5-d82497c42884]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bc46f-2e0c-45cd-acc3-f19da824ba71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:42:24 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:42:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe03a593-4d5a-4ff6-8781-a56119e18ca3]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG os_brick.utils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:24 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating existing volume attachment record: 10b354f4-4da7-49f3-8fd9-d0902fa09dfe {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:42:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Creating image(s)
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.129s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk 1073741824" returned: 0 in 0.048s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Cannot resize image /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Ensure instance console log exists: /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Start _get_guest_xml network_info=[{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ca3c320-bf1c-43b5-973c-4d73b22487ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5', 'serial': 'a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'}, 'attachment_id': '6dc6a804-bd48-4a35-93be-353331a2301c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:42:27 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 02 23:42:27 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:27 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:27 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:27 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf441a5-5513-4144-997d-c4bcd36167ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:42:27 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47cc19c-5e7a-425a-bab7-7706c434b300]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5] added
Aug 02 23:42:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ab6d56-235e-4325-bcf1-de9220ceea47]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce80cd1d-f4cb-4078-8f4b-a7b76e05becd]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scUhPfMT {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scUhPfMT" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a91c7aa-4e47-47aa-a6b8-5dbfc7e4a219]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scUhPfMT'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[01987e74-01e0-4a01-918b-f964024e5e11]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fddd5ef-962e-4283-816c-3acd39ea98c3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93acd4c1-a695-4c92-9f12-5c24ced76345]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]
Aug 02 23:42:27 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.
Aug 02 23:42:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d249aa-520c-4a76-84bb-4b351b13310c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[48303c61-718c-4441-a5c8-b561e0bb738c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:28 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:28 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:28 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:28 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e42d87-9eaa-4451-b5c0-166b6135e3ad]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:42:28 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23837346237663165', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837346237663165', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1926157642',display_name='tempest-ServerActionsTestOtherA-server-1536478268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1926157642',id=20,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-8ioinyiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=6ca3c320-bf1c-43b5-973c-4d73b22487ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:42:29 user nova-compute[72520]:   <uuid>6ca3c320-bf1c-43b5-973c-4d73b22487ac</uuid>
Aug 02 23:42:29 user nova-compute[72520]:   <name>instance-00000014</name>
Aug 02 23:42:29 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:42:29 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:42:29 user nova-compute[72520]:   <metadata>
Aug 02 23:42:29 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:42:29 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:42:29 user nova-compute[72520]:       <nova:name>tempest-ServerActionsTestOtherA-server-1536478268</nova:name>
Aug 02 23:42:29 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:42:27</nova:creationTime>
Aug 02 23:42:29 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:42:29 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:42:29 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:42:29 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:42:29 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:42:29 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:42:29 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:42:29 user nova-compute[72520]:       <nova:owner>
Aug 02 23:42:29 user nova-compute[72520]:         <nova:user uuid="e4848df27d404a9eb33ec7e7dd45dd12">tempest-ServerActionsTestOtherA-102203488-project-member</nova:user>
Aug 02 23:42:29 user nova-compute[72520]:         <nova:project uuid="c2f50f35e2b7466ea2a922b0525b2fb1">tempest-ServerActionsTestOtherA-102203488</nova:project>
Aug 02 23:42:29 user nova-compute[72520]:       </nova:owner>
Aug 02 23:42:29 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:42:29 user nova-compute[72520]:       <nova:ports>
Aug 02 23:42:29 user nova-compute[72520]:         <nova:port uuid="ad1bea50-6df7-41da-b7db-48366aeb40b3">
Aug 02 23:42:29 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 02 23:42:29 user nova-compute[72520]:         </nova:port>
Aug 02 23:42:29 user nova-compute[72520]:       </nova:ports>
Aug 02 23:42:29 user nova-compute[72520]:     </nova:instance>
Aug 02 23:42:29 user nova-compute[72520]:   </metadata>
Aug 02 23:42:29 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:42:29 user nova-compute[72520]:     <system>
Aug 02 23:42:29 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:42:29 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:42:29 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:42:29 user nova-compute[72520]:       <entry name="serial">6ca3c320-bf1c-43b5-973c-4d73b22487ac</entry>
Aug 02 23:42:29 user nova-compute[72520]:       <entry name="uuid">6ca3c320-bf1c-43b5-973c-4d73b22487ac</entry>
Aug 02 23:42:29 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:42:29 user nova-compute[72520]:     </system>
Aug 02 23:42:29 user nova-compute[72520]:   </sysinfo>
Aug 02 23:42:29 user nova-compute[72520]:   <os>
Aug 02 23:42:29 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:42:29 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:42:29 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:42:29 user nova-compute[72520]:   </os>
Aug 02 23:42:29 user nova-compute[72520]:   <features>
Aug 02 23:42:29 user nova-compute[72520]:     <acpi/>
Aug 02 23:42:29 user nova-compute[72520]:     <apic/>
Aug 02 23:42:29 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:42:29 user nova-compute[72520]:   </features>
Aug 02 23:42:29 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:42:29 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:42:29 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:42:29 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:42:29 user nova-compute[72520]:   </clock>
Aug 02 23:42:29 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:42:29 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:42:29 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:42:29 user nova-compute[72520]:   </cpu>
Aug 02 23:42:29 user nova-compute[72520]:   <devices>
Aug 02 23:42:29 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:42:29 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:42:29 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk"/>
Aug 02 23:42:29 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:42:29 user nova-compute[72520]:     </disk>
Aug 02 23:42:29 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:42:29 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:42:29 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 02 23:42:29 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:42:29 user nova-compute[72520]:       <serial>a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5</serial>
Aug 02 23:42:29 user nova-compute[72520]:     </disk>
Aug 02 23:42:29 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:42:29 user nova-compute[72520]:       <mac address="fa:16:3e:4a:23:f6"/>
Aug 02 23:42:29 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:42:29 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:42:29 user nova-compute[72520]:       <target dev="tapad1bea50-6d"/>
Aug 02 23:42:29 user nova-compute[72520]:     </interface>
Aug 02 23:42:29 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:42:29 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/console.log" append="off"/>
Aug 02 23:42:29 user nova-compute[72520]:     </serial>
Aug 02 23:42:29 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:42:29 user nova-compute[72520]:     <video>
Aug 02 23:42:29 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:42:29 user nova-compute[72520]:     </video>
Aug 02 23:42:29 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:42:29 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:42:29 user nova-compute[72520]:     </rng>
Aug 02 23:42:29 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:42:29 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:42:29 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:42:29 user nova-compute[72520]:     </memballoon>
Aug 02 23:42:29 user nova-compute[72520]:   </devices>
Aug 02 23:42:29 user nova-compute[72520]: </domain>
Aug 02 23:42:29 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1926157642',display_name='tempest-ServerActionsTestOtherA-server-1536478268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1926157642',id=20,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-8ioinyiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=6ca3c320-bf1c-43b5-973c-4d73b22487ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG os_vif [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad1bea50-6d, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad1bea50-6d, col_values=(('external_ids', {'iface-id': 'ad1bea50-6df7-41da-b7db-48366aeb40b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:23:f6', 'vm-uuid': '6ca3c320-bf1c-43b5-973c-4d73b22487ac'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:29 user nova-compute[72520]: INFO os_vif [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d')
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No VIF found with MAC fa:16:3e:4a:23:f6, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG nova.compute.manager [req-54ac653f-391f-4080-a87a-37bdfe4ff08d req-308bd2ce-734a-4351-b4d7-57b865c02785 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54ac653f-391f-4080-a87a-37bdfe4ff08d req-308bd2ce-734a-4351-b4d7-57b865c02785 service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54ac653f-391f-4080-a87a-37bdfe4ff08d req-308bd2ce-734a-4351-b4d7-57b865c02785 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-54ac653f-391f-4080-a87a-37bdfe4ff08d req-308bd2ce-734a-4351-b4d7-57b865c02785 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:30 user nova-compute[72520]: DEBUG nova.compute.manager [req-54ac653f-391f-4080-a87a-37bdfe4ff08d req-308bd2ce-734a-4351-b4d7-57b865c02785 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:30 user nova-compute[72520]: WARNING nova.compute.manager [req-54ac653f-391f-4080-a87a-37bdfe4ff08d req-308bd2ce-734a-4351-b4d7-57b865c02785 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received unexpected event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with vm_state active and task_state rebuild_spawning.
Aug 02 23:42:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for 6ca3c320-bf1c-43b5-973c-4d73b22487ac due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019752.6014736, 6ca3c320-bf1c-43b5-973c-4d73b22487ac => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:42:32 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] VM Resumed (Lifecycle Event)
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:42:32 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance spawned successfully.
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:42:32 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019752.6028535, 6ca3c320-bf1c-43b5-973c-4d73b22487ac => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:42:32 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] VM Started (Lifecycle Event)
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:32 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmqJcaBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:32 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:32 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:32 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ccc077-c1ae-45a8-ae33-0c5e6123bf72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:42:32 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db12baee-c684-414f-b2e6-f619d622cf30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa] added
Aug 02 23:42:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [req-529b4983-8698-4137-8a61-5c37f4214459 req-171ce0a5-d7a5-426c-9fcf-737485d6bbf8 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-529b4983-8698-4137-8a61-5c37f4214459 req-171ce0a5-d7a5-426c-9fcf-737485d6bbf8 service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-529b4983-8698-4137-8a61-5c37f4214459 req-171ce0a5-d7a5-426c-9fcf-737485d6bbf8 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-529b4983-8698-4137-8a61-5c37f4214459 req-171ce0a5-d7a5-426c-9fcf-737485d6bbf8 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG nova.compute.manager [req-529b4983-8698-4137-8a61-5c37f4214459 req-171ce0a5-d7a5-426c-9fcf-737485d6bbf8 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:32 user nova-compute[72520]: WARNING nova.compute.manager [req-529b4983-8698-4137-8a61-5c37f4214459 req-171ce0a5-d7a5-426c-9fcf-737485d6bbf8 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received unexpected event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with vm_state active and task_state None.
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f33fb2-b883-43dc-bcc7-30b4556e7cc8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d8adb0-3450-4c05-9929-3fbb874534d3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmqJcaBj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-522cf96f-3017-4506-ac6f-ce5538a87882 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmqJcaBj" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4b5b8-d43b-4b91-a642-1ea7c614ba95]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KmqJcaBj'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c9a1d-a875-4d2b-a2d1-b6ddeffa687f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8113b8b8-ffb9-4e72-a080-d4cba5716c50]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:32 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:32 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e51f2cc-7d5f-47dd-9b27-7da5c0e7c8c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260]
Aug 02 23:42:32 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260] successful.
Aug 02 23:42:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fa1675-96e2-4eca-8dff-13b4aa12909e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfb2df-be03-43a4-ac5a-a56bc9963308]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:33 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:33 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:42:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:33 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:33 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:42:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9f9d6f-f282-44b7-a53b-3d9825d42826]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:42:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmqJcaBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23566396536333638', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566396536333638', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'flavor' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:42:34 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:42:34 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:42:34 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:42:34 user nova-compute[72520]:   <serial>bcd70029-053c-4e74-a20b-7d41eccdebfa</serial>
Aug 02 23:42:34 user nova-compute[72520]: </disk>
Aug 02 23:42:34 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No VIF found with MAC fa:16:3e:53:22:15, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:42:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5da954fd-0b01-485c-90ca-05779d2dcc5f tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.853s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:35 user nova-compute[72520]: INFO nova.compute.manager [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Rescuing
Aug 02 23:42:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:42:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquired lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:42:35 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Releasing lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-5aeca765-275c-45f0-a430-f0a6a6c465cc req-407fa0cd-7e72-41f4-8387-6a1f1e7dd2a2 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5aeca765-275c-45f0-a430-f0a6a6c465cc req-407fa0cd-7e72-41f4-8387-6a1f1e7dd2a2 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5aeca765-275c-45f0-a430-f0a6a6c465cc req-407fa0cd-7e72-41f4-8387-6a1f1e7dd2a2 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5aeca765-275c-45f0-a430-f0a6a6c465cc req-407fa0cd-7e72-41f4-8387-6a1f1e7dd2a2 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-5aeca765-275c-45f0-a430-f0a6a6c465cc req-407fa0cd-7e72-41f4-8387-6a1f1e7dd2a2 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:36 user nova-compute[72520]: WARNING nova.compute.manager [req-5aeca765-275c-45f0-a430-f0a6a6c465cc req-407fa0cd-7e72-41f4-8387-6a1f1e7dd2a2 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance destroyed successfully.
Aug 02 23:42:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Attempting a stable device rescue
Aug 02 23:42:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 02 23:42:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Creating image(s)
Aug 02 23:42:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'trusted_certs' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "cfa3795d2eb41a681d566391869dc900a4639be5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "cfa3795d2eb41a681d566391869dc900a4639be5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.part --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.virt.images [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] ba546157-35ac-48f4-9d5e-0b21eba9e511 was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.part /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:38 user nova-compute[72520]: WARNING nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:38 user nova-compute[72520]: WARNING nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:38 user nova-compute[72520]: WARNING nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:38 user nova-compute[72520]: WARNING nova.compute.manager [req-3c668c24-e865-4547-baa2-c20b78e418f0 req-2976e2b2-6af7-4257-aa7e-2ec459ec1e23 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.part /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.converted" returned: 0 in 0.218s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "cfa3795d2eb41a681d566391869dc900a4639be5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.713s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "cfa3795d2eb41a681d566391869dc900a4639be5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "cfa3795d2eb41a681d566391869dc900a4639be5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5 --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5,backing_fmt=raw /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5,backing_fmt=raw /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue" returned: 0 in 0.052s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "cfa3795d2eb41a681d566391869dc900a4639be5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'migration_context' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Start _get_guest_xml network_info=[{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "vif_mac": "fa:16:3e:53:22:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ba546157-35ac-48f4-9d5e-0b21eba9e511', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmqJcaBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '446c2a07-5fa9-441c-96d8-36d0ca812d1b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcd70029-053c-4e74-a20b-7d41eccdebfa', 'serial': 'bcd70029-053c-4e74-a20b-7d41eccdebfa'}, 'attachment_id': '10b354f4-4da7-49f3-8fd9-d0902fa09dfe', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'resources' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'numa_topology' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:42:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'vcpu_model' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmqJcaBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:42:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:42:39 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f336f74-606e-4bf0-9c79-b0197964de2f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KmqJcaBj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 02 23:42:39 user nova-compute[72520]: node.name = iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa
Aug 02 23:42:39 user nova-compute[72520]: node.tpgt = -1
Aug 02 23:42:39 user nova-compute[72520]: node.startup = automatic
Aug 02 23:42:39 user nova-compute[72520]: node.leading_login = No
Aug 02 23:42:39 user nova-compute[72520]: iface.iscsi_ifacename = default
Aug 02 23:42:39 user nova-compute[72520]: iface.net_ifacename = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.ipaddress = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.prefix_len = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.hwaddress = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.transport_name = tcp
Aug 02 23:42:39 user nova-compute[72520]: iface.initiatorname = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.state = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.vlan_id = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.vlan_priority = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.vlan_state = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.iface_num = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.mtu = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.port = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.bootproto = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.subnet_mask = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.gateway = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_alt_client_id_state = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_alt_client_id = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_dns = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_learn_iqn = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_req_vendor_id_state = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_vendor_id_state = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_vendor_id = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.dhcp_slp_da = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.fragmentation = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.gratuitous_arp = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.incoming_forwarding = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.tos_state = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.tos = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.ttl = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.delayed_ack = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.tcp_nagle = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.tcp_wsf_state = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.tcp_wsf = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.tcp_timer_scale = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.tcp_timestamp = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.redirect = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.def_task_mgmt_timeout = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.header_digest = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.data_digest = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.immediate_data = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.initial_r2t = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.data_seq_inorder = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.data_pdu_inorder = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.erl = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.max_receive_data_len = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.first_burst_len = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.max_outstanding_r2t = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.max_burst_len = 0
Aug 02 23:42:39 user nova-compute[72520]: iface.chap_auth = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.bidi_chap = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.strict_login_compliance = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.discovery_auth = <empty>
Aug 02 23:42:39 user nova-compute[72520]: iface.discovery_logout = <empty>
Aug 02 23:42:39 user nova-compute[72520]: node.discovery_address = <empty>
Aug 02 23:42:39 user nova-compute[72520]: node.discovery_port = 0
Aug 02 23:42:39 user nova-compute[72520]: node.discovery_type = static
Aug 02 23:42:39 user nova-compute[72520]: node.session.initial_cmdsn = 0
Aug 02 23:42:39 user nova-compute[72520]: node.session.initial_login_retry_max = 8
Aug 02 23:42:39 user nova-compute[72520]: node.session.xmit_thread_priority = -20
Aug 02 23:42:39 user nova-compute[72520]: node.session.cmds_max = 128
Aug 02 23:42:39 user nova-compute[72520]: node.session.queue_depth = 32
Aug 02 23:42:39 user nova-compute[72520]: node.session.nr_sessions = 1
Aug 02 23:42:39 user nova-compute[72520]: node.session.auth.authmethod = CHAP
Aug 02 23:42:39 user nova-compute[72520]: node.session.auth.username = KmqJcaBj
Aug 02 23:42:39 user nova-compute[72520]: node.session.auth.password = ***
Aug 02 23:42:39 user nova-compute[72520]: node.session.auth.username_in = <empty>
Aug 02 23:42:39 user nova-compute[72520]: node.session.auth.password_in = <empty>
Aug 02 23:42:39 user nova-compute[72520]: node.session.auth.chap_algs = MD5
Aug 02 23:42:39 user nova-compute[72520]: node.session.timeo.replacement_timeout = 120
Aug 02 23:42:39 user nova-compute[72520]: node.session.err_timeo.abort_timeout = 15
Aug 02 23:42:39 user nova-compute[72520]: node.session.err_timeo.lu_reset_timeout = 30
Aug 02 23:42:39 user nova-compute[72520]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 02 23:42:39 user nova-compute[72520]: node.session.err_timeo.host_reset_timeout = 60
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.FastAbort = Yes
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.InitialR2T = No
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.ImmediateData = Yes
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.FirstBurstLength = 262144
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.MaxBurstLength = 16776192
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.DefaultTime2Retain = 0
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.DefaultTime2Wait = 2
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.MaxConnections = 1
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 02 23:42:39 user nova-compute[72520]: node.session.iscsi.ERL = 0
Aug 02 23:42:39 user nova-compute[72520]: node.session.scan = manual
Aug 02 23:42:39 user nova-compute[72520]: node.session.reopen_max = 0
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].address = 172.16.0.220
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].port = 3260
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].startup = manual
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].tcp.window_size = 524288
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].tcp.type_of_service = 0
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].timeo.logout_timeout = 15
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].timeo.login_timeout = 15
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].timeo.auth_timeout = 45
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].timeo.noop_out_interval = 5
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].timeo.noop_out_timeout = 5
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].iscsi.HeaderDigest = None
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].iscsi.DataDigest = None
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].iscsi.IFMarker = No
Aug 02 23:42:39 user nova-compute[72520]: node.conn[0].iscsi.OFMarker = No
Aug 02 23:42:39 user nova-compute[72520]: # END RECORD
Aug 02 23:42:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ef0613-e06a-4e0e-b0f3-6fd882856f90]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b6e6c5-9246-40e2-9b39-2690d1371104]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmqJcaBj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmqJcaBj" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89287089-1e8a-464b-8b74-64e419ac42e7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KmqJcaBj'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b03d18-7482-49c3-bf2a-c4c7ce1ceb98]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[274351be-b0ce-45e0-bf6f-4870236403a5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:39 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:39 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:42:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:42:39 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:42:39 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:42:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] HCTL ('35', '0', '0', 0) found on session 31 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0c9748-e064-476e-a9a3-d9f0a0f86c84]: (4, ('0 0 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Searching for a device in session 31 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmqJcaBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23566396536333638', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566396536333638', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-14401138',display_name='tempest-ServerStableDeviceRescueTest-server-14401138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-14401138',id=21,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI99MH/yOy+zyw/6T3gBphmJlKu8fUQAHAInZKk9Q5NAwgz2XPB2/bm1r9zRCsg5BNmCXmkpBXDQlOfDONe6S8PzoZjf2BrdEcciBgaPD6dr7udYlbYRVCJm8xAxw05eng==',key_name='tempest-keypair-1607586224',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:38:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce093aec44554569978366f3d15b9674',ramdisk_id='',reservation_id='r-mlzy31o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-702900337',owner_user_name='tempest-ServerStableDeviceRescueTest-702900337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa5a76e9ec8400db509e46df8d3221e',uuid=446c2a07-5fa9-441c-96d8-36d0ca812d1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "vif_mac": "fa:16:3e:53:22:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converting VIF {"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "vif_mac": "fa:16:3e:53:22:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'pci_devices' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:42:39 user nova-compute[72520]:   <uuid>446c2a07-5fa9-441c-96d8-36d0ca812d1b</uuid>
Aug 02 23:42:39 user nova-compute[72520]:   <name>instance-00000015</name>
Aug 02 23:42:39 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:42:39 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:42:39 user nova-compute[72520]:   <metadata>
Aug 02 23:42:39 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:42:39 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:42:39 user nova-compute[72520]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-14401138</nova:name>
Aug 02 23:42:39 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:42:39</nova:creationTime>
Aug 02 23:42:39 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:42:39 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:42:39 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:42:39 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:42:39 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:42:39 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:42:39 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:42:39 user nova-compute[72520]:       <nova:owner>
Aug 02 23:42:39 user nova-compute[72520]:         <nova:user uuid="faa5a76e9ec8400db509e46df8d3221e">tempest-ServerStableDeviceRescueTest-702900337-project-member</nova:user>
Aug 02 23:42:39 user nova-compute[72520]:         <nova:project uuid="ce093aec44554569978366f3d15b9674">tempest-ServerStableDeviceRescueTest-702900337</nova:project>
Aug 02 23:42:39 user nova-compute[72520]:       </nova:owner>
Aug 02 23:42:39 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:42:39 user nova-compute[72520]:       <nova:ports>
Aug 02 23:42:39 user nova-compute[72520]:         <nova:port uuid="1b164377-0056-4bbd-9be0-9c22a46148b6">
Aug 02 23:42:39 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 02 23:42:39 user nova-compute[72520]:         </nova:port>
Aug 02 23:42:39 user nova-compute[72520]:       </nova:ports>
Aug 02 23:42:39 user nova-compute[72520]:     </nova:instance>
Aug 02 23:42:39 user nova-compute[72520]:   </metadata>
Aug 02 23:42:39 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:42:39 user nova-compute[72520]:     <system>
Aug 02 23:42:39 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:42:39 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:42:39 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:42:39 user nova-compute[72520]:       <entry name="serial">446c2a07-5fa9-441c-96d8-36d0ca812d1b</entry>
Aug 02 23:42:39 user nova-compute[72520]:       <entry name="uuid">446c2a07-5fa9-441c-96d8-36d0ca812d1b</entry>
Aug 02 23:42:39 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:42:39 user nova-compute[72520]:     </system>
Aug 02 23:42:39 user nova-compute[72520]:   </sysinfo>
Aug 02 23:42:39 user nova-compute[72520]:   <os>
Aug 02 23:42:39 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:42:39 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:42:39 user nova-compute[72520]:   </os>
Aug 02 23:42:39 user nova-compute[72520]:   <features>
Aug 02 23:42:39 user nova-compute[72520]:     <acpi/>
Aug 02 23:42:39 user nova-compute[72520]:     <apic/>
Aug 02 23:42:39 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:42:39 user nova-compute[72520]:   </features>
Aug 02 23:42:39 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:42:39 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:42:39 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:42:39 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:42:39 user nova-compute[72520]:   </clock>
Aug 02 23:42:39 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:42:39 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:42:39 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:42:39 user nova-compute[72520]:   </cpu>
Aug 02 23:42:39 user nova-compute[72520]:   <devices>
Aug 02 23:42:39 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:42:39 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:42:39 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk"/>
Aug 02 23:42:39 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:42:39 user nova-compute[72520]:     </disk>
Aug 02 23:42:39 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:42:39 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:42:39 user nova-compute[72520]:       <source dev="/dev/sdd"/>
Aug 02 23:42:39 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:42:39 user nova-compute[72520]:       <serial>bcd70029-053c-4e74-a20b-7d41eccdebfa</serial>
Aug 02 23:42:39 user nova-compute[72520]:     </disk>
Aug 02 23:42:39 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:42:39 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:42:39 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue"/>
Aug 02 23:42:39 user nova-compute[72520]:       <target dev="vdc" bus="virtio"/>
Aug 02 23:42:39 user nova-compute[72520]:       <boot order="1"/>
Aug 02 23:42:39 user nova-compute[72520]:     </disk>
Aug 02 23:42:39 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:42:39 user nova-compute[72520]:       <mac address="fa:16:3e:53:22:15"/>
Aug 02 23:42:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:42:39 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:42:39 user nova-compute[72520]:       <target dev="tap1b164377-00"/>
Aug 02 23:42:39 user nova-compute[72520]:     </interface>
Aug 02 23:42:39 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:42:39 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/console.log" append="off"/>
Aug 02 23:42:39 user nova-compute[72520]:     </serial>
Aug 02 23:42:39 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:42:39 user nova-compute[72520]:     <video>
Aug 02 23:42:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:42:39 user nova-compute[72520]:     </video>
Aug 02 23:42:39 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:42:39 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:42:39 user nova-compute[72520]:     </rng>
Aug 02 23:42:39 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:42:39 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:42:39 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:42:39 user nova-compute[72520]:     </memballoon>
Aug 02 23:42:39 user nova-compute[72520]:   </devices>
Aug 02 23:42:39 user nova-compute[72520]: </domain>
Aug 02 23:42:39 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:42:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance destroyed successfully.
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:42:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] No VIF found with MAC fa:16:3e:53:22:15, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:40 user nova-compute[72520]: INFO nova.compute.manager [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Terminating instance
Aug 02 23:42:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:40 user nova-compute[72520]: WARNING nova.compute.manager [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-unplugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-unplugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-f9974847-b957-4663-9c03-e7bbb8ea13a2 req-3d475784-bf18-4cec-9432-92c8c2f54b66 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-unplugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Instance destroyed successfully.
Aug 02 23:42:41 user nova-compute[72520]: DEBUG nova.objects.instance [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lazy-loading 'resources' on Instance uuid bdf4e227-f9cb-4cee-b9ef-c649ca597031 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112342475',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2112342475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2112342',id=22,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICtHKY84C4vAQqHU6tapaQcEdVZMczalVdnrXA5aI+L86jmhMZvZKHOuHq7ttRUBg9lexCQ2DH9Wsb0B8f12ZpZ4mkK+EADtYAky7lgztw/waRggTojXU1IYEoVffllTw==',key_name='tempest-keypair-87205325',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:39:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d226af347f24fe68dec034ee7dce8b5',ramdisk_id='',reservation_id='r-9eluyrd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1455741476',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc59aed3bf5406ba8224f8ceb6e21ec',uuid=bdf4e227-f9cb-4cee-b9ef-c649ca597031,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Converting VIF {"id": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "address": "fa:16:3e:28:80:6f", "network": {"id": "88318ec3-5d6d-46ab-842c-580cc65c464f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1093131183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d226af347f24fe68dec034ee7dce8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd1bd8d-d7", "ovs_interfaceid": "5bd1bd8d-d763-4724-baa7-caece32ab2ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:80:6f,bridge_name='br-int',has_traffic_filtering=True,id=5bd1bd8d-d763-4724-baa7-caece32ab2ae,network=Network(88318ec3-5d6d-46ab-842c-580cc65c464f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd1bd8d-d7') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG os_vif [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:80:6f,bridge_name='br-int',has_traffic_filtering=True,id=5bd1bd8d-d763-4724-baa7-caece32ab2ae,network=Network(88318ec3-5d6d-46ab-842c-580cc65c464f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd1bd8d-d7') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd1bd8d-d7, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:42:41 user nova-compute[72520]: INFO os_vif [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:80:6f,bridge_name='br-int',has_traffic_filtering=True,id=5bd1bd8d-d763-4724-baa7-caece32ab2ae,network=Network(88318ec3-5d6d-46ab-842c-580cc65c464f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd1bd8d-d7')
Aug 02 23:42:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Deleting instance files /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031_del
Aug 02 23:42:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Deletion of /opt/stack/data/nova/instances/bdf4e227-f9cb-4cee-b9ef-c649ca597031_del complete
Aug 02 23:42:41 user nova-compute[72520]: INFO nova.compute.manager [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 02 23:42:41 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:42:41 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:42:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:43 user nova-compute[72520]: WARNING nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received unexpected event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with vm_state active and task_state deleting.
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:43 user nova-compute[72520]: WARNING nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:43 user nova-compute[72520]: WARNING nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state active and task_state rescuing.
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:43 user nova-compute[72520]: WARNING nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received unexpected event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with vm_state active and task_state deleting.
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:43 user nova-compute[72520]: WARNING nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received unexpected event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with vm_state active and task_state deleting.
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-unplugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-unplugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-92259f5b-5051-4d64-844b-36dbc9b2f72e req-f018a4cd-f1be-40ac-bd71-45d9c5d69807 service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-unplugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:42:43 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Took 1.55 seconds to deallocate network for instance.
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:42:43 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:42:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:44 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Deleted allocations for instance bdf4e227-f9cb-4cee-b9ef-c649ca597031
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for 446c2a07-5fa9-441c-96d8-36d0ca812d1b due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019764.1216435, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:42:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] VM Resumed (Lifecycle Event)
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ac6f3047-d6f4-4c41-a054-5312ae3a1288 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:42:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0ab7814d-935b-44dc-975b-7db9864b22db tempest-TestServerVolumeAttachScenarioOldVersion-1455741476 tempest-TestServerVolumeAttachScenarioOldVersion-1455741476-project-member] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.730s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019764.1236262, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:42:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] VM Started (Lifecycle Event)
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:42:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c7ae0f4-8ffb-4709-9690-c4e6b654c31d req-4810fc2a-d3dd-4e87-8044-9ebf79678a5d service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c7ae0f4-8ffb-4709-9690-c4e6b654c31d req-4810fc2a-d3dd-4e87-8044-9ebf79678a5d service nova] Acquiring lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c7ae0f4-8ffb-4709-9690-c4e6b654c31d req-4810fc2a-d3dd-4e87-8044-9ebf79678a5d service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3c7ae0f4-8ffb-4709-9690-c4e6b654c31d req-4810fc2a-d3dd-4e87-8044-9ebf79678a5d service nova] Lock "bdf4e227-f9cb-4cee-b9ef-c649ca597031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c7ae0f4-8ffb-4709-9690-c4e6b654c31d req-4810fc2a-d3dd-4e87-8044-9ebf79678a5d service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] No waiting events found dispatching network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:42:45 user nova-compute[72520]: WARNING nova.compute.manager [req-3c7ae0f4-8ffb-4709-9690-c4e6b654c31d req-4810fc2a-d3dd-4e87-8044-9ebf79678a5d service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received unexpected event network-vif-plugged-5bd1bd8d-d763-4724-baa7-caece32ab2ae for instance with vm_state deleted and task_state None.
Aug 02 23:42:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-3c7ae0f4-8ffb-4709-9690-c4e6b654c31d req-4810fc2a-d3dd-4e87-8044-9ebf79678a5d service nova] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Received event network-vif-deleted-5bd1bd8d-d763-4724-baa7-caece32ab2ae {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:42:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:49 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:42:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:42:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=25.35135269165039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019761.8535314, bdf4e227-f9cb-4cee-b9ef-c649ca597031 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:42:56 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] VM Stopped (Lifecycle Event)
Aug 02 23:42:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-3237b73b-2e5e-4900-8c08-2cd93b35ecbe None None] [instance: bdf4e227-f9cb-4cee-b9ef-c649ca597031] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:42:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:42:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:42:58 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:42:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:07 user nova-compute[72520]: INFO nova.compute.manager [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Unrescuing
Aug 02 23:43:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG nova.network.neutron [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG nova.network.neutron [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG nova.objects.instance [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'flavor' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-10ca67ae-6a75-4f85-84e4-65433e5c97d5 req-a6a4ffe9-452e-4e51-ba1b-b20770c9c1d3 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-10ca67ae-6a75-4f85-84e4-65433e5c97d5 req-a6a4ffe9-452e-4e51-ba1b-b20770c9c1d3 service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-10ca67ae-6a75-4f85-84e4-65433e5c97d5 req-a6a4ffe9-452e-4e51-ba1b-b20770c9c1d3 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-10ca67ae-6a75-4f85-84e4-65433e5c97d5 req-a6a4ffe9-452e-4e51-ba1b-b20770c9c1d3 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-10ca67ae-6a75-4f85-84e4-65433e5c97d5 req-a6a4ffe9-452e-4e51-ba1b-b20770c9c1d3 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:07 user nova-compute[72520]: WARNING nova.compute.manager [req-10ca67ae-6a75-4f85-84e4-65433e5c97d5 req-a6a4ffe9-452e-4e51-ba1b-b20770c9c1d3 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance destroyed successfully.
Aug 02 23:43:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:10 user nova-compute[72520]: WARNING nova.compute.manager [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:10 user nova-compute[72520]: WARNING nova.compute.manager [req-1a73ad80-a2b3-4ec4-9850-cee29384fee1 req-7c54bf69-39e6-43c8-9a66-1cce5cbd7b13 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019791.7826366, f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:43:11 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] VM Resumed (Lifecycle Event)
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-57fe2269-2198-463b-9883-f832a4187df4 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:43:11 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019791.786843, f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:43:11 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] VM Started (Lifecycle Event)
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:43:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:43:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-5ce7b68a-3ba0-4d15-aa8a-869fc4534e43 req-85f5d6bc-ae87-4ecc-ba91-b02bb85a880c service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ce7b68a-3ba0-4d15-aa8a-869fc4534e43 req-85f5d6bc-ae87-4ecc-ba91-b02bb85a880c service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ce7b68a-3ba0-4d15-aa8a-869fc4534e43 req-85f5d6bc-ae87-4ecc-ba91-b02bb85a880c service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ce7b68a-3ba0-4d15-aa8a-869fc4534e43 req-85f5d6bc-ae87-4ecc-ba91-b02bb85a880c service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-5ce7b68a-3ba0-4d15-aa8a-869fc4534e43 req-85f5d6bc-ae87-4ecc-ba91-b02bb85a880c service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:12 user nova-compute[72520]: WARNING nova.compute.manager [req-5ce7b68a-3ba0-4d15-aa8a-869fc4534e43 req-85f5d6bc-ae87-4ecc-ba91-b02bb85a880c service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state active and task_state None.
Aug 02 23:43:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:19 user nova-compute[72520]: INFO nova.compute.manager [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Unrescuing
Aug 02 23:43:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG nova.network.neutron [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG nova.network.neutron [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating instance_info_cache with network_info: [{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'flavor' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-88bf4cf2-a7c6-4ad5-a939-39699062e0bf req-960ab96b-6c68-45bc-a050-3a26eb079f79 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-88bf4cf2-a7c6-4ad5-a939-39699062e0bf req-960ab96b-6c68-45bc-a050-3a26eb079f79 service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-88bf4cf2-a7c6-4ad5-a939-39699062e0bf req-960ab96b-6c68-45bc-a050-3a26eb079f79 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-88bf4cf2-a7c6-4ad5-a939-39699062e0bf req-960ab96b-6c68-45bc-a050-3a26eb079f79 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-88bf4cf2-a7c6-4ad5-a939-39699062e0bf req-960ab96b-6c68-45bc-a050-3a26eb079f79 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:19 user nova-compute[72520]: WARNING nova.compute.manager [req-88bf4cf2-a7c6-4ad5-a939-39699062e0bf req-960ab96b-6c68-45bc-a050-3a26eb079f79 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance destroyed successfully.
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:22 user nova-compute[72520]: WARNING nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:22 user nova-compute[72520]: WARNING nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:22 user nova-compute[72520]: WARNING nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:22 user nova-compute[72520]: WARNING nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:22 user nova-compute[72520]: WARNING nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:22 user nova-compute[72520]: WARNING nova.compute.manager [req-8d4f4223-c263-4bf3-81a5-420aee7d16da req-e75c4224-7c8a-41b8-a643-fdf977e998be service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:43:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for fb121921-3b3c-43dc-ad9a-8aa1d5c49301 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019803.8791795, fb121921-3b3c-43dc-ad9a-8aa1d5c49301 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:43:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] VM Resumed (Lifecycle Event)
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1c3afa41-5fb4-4b41-86ea-c2887a6e5f21 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:43:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019803.8810575, fb121921-3b3c-43dc-ad9a-8aa1d5c49301 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:43:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] VM Started (Lifecycle Event)
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:43:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:43:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-321abf99-53d8-4b7f-9fd1-07d66618555e req-60334dad-e98a-4d7d-a018-866edae9a49b service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-321abf99-53d8-4b7f-9fd1-07d66618555e req-60334dad-e98a-4d7d-a018-866edae9a49b service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-321abf99-53d8-4b7f-9fd1-07d66618555e req-60334dad-e98a-4d7d-a018-866edae9a49b service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-321abf99-53d8-4b7f-9fd1-07d66618555e req-60334dad-e98a-4d7d-a018-866edae9a49b service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-321abf99-53d8-4b7f-9fd1-07d66618555e req-60334dad-e98a-4d7d-a018-866edae9a49b service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:43:24 user nova-compute[72520]: WARNING nova.compute.manager [req-321abf99-53d8-4b7f-9fd1-07d66618555e req-60334dad-e98a-4d7d-a018-866edae9a49b service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state active and task_state None.
Aug 02 23:43:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-changed-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Refreshing instance network info cache due to event network-changed-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:43:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] Acquiring lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:43:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] Acquired lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:43:28 user nova-compute[72520]: DEBUG nova.network.neutron [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Refreshing network info cache for port a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:43:29 user nova-compute[72520]: DEBUG nova.network.neutron [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Updated VIF entry in instance network info cache for port a416bd60-1ce5-4b6b-b4c9-f530f63d0a42. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:43:29 user nova-compute[72520]: DEBUG nova.network.neutron [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Updating instance_info_cache with network_info: [{"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:43:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d31a873a-8a1b-4eec-8806-97c509423306 req-3d67bae9-5a8e-4984-985a-fff77aac14f1 service nova] Releasing lock "refresh_cache-2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:43:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:32 user nova-compute[72520]: INFO nova.compute.manager [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Attaching volume 6385428c-cfde-4eab-89ea-a8b25d48246f to /dev/vdb
Aug 02 23:43:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e39b690-836e-4b43-a953-50900b565d3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5096ce-3421-4ccc-9258-2bb3e92b0da7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b57cd6-1db9-492d-8408-0e98285090a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a20844-b913-4621-a044-73744bdab31e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:43:32 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:43:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a840b5-e013-4a4a-aa39-fc9dc52d836c]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:43:32 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Updating existing volume attachment record: a7bbc383-99ec-478a-ac37-e1953363a180 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:43:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTWIzRXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:43:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:43:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:43:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:43:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:43:40 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:43:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5b9d6-9c65-4df0-b6b8-36b50016759f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:43:40 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c6e05-e5da-4267-96b1-76551889c4e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f] added
Aug 02 23:43:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fca990d-cee1-4232-9ea9-80695ad88fea]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c016d9ea-1b1e-4bcb-8c25-6dab9f2eeb03]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTWIzRXy {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTWIzRXy" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f6bedf-3fe5-432a-848a-f9838ee4ec5e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dTWIzRXy'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42341542-ca32-48da-9145-9425f62f5a89]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d65708a-0a8f-41ba-ae0c-18ed5fd3f8ed]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:43:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:43:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0994ec4-f436-41a0-87f5-963be1bf7fcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260]
Aug 02 23:43:41 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260] successful.
Aug 02 23:43:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b1d2df-88ba-416e-8b51-42c19a87d61d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8c55a9-f9c6-468b-a240-510fdfaea2f8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f (non-flash)
Aug 02 23:43:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:43:41 user nova-compute[72520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f (non-flash)
Aug 02 23:43:41 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[92733641-9646-4df3-aa77-c327710e8520]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTWIzRXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:43:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23864383539623631', 'path': '/dev/sde'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864383539623631', 'path': '/dev/sde'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:43:42 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:43:42 user nova-compute[72520]:   <source dev="/dev/sde"/>
Aug 02 23:43:42 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:43:42 user nova-compute[72520]:   <serial>6385428c-cfde-4eab-89ea-a8b25d48246f</serial>
Aug 02 23:43:42 user nova-compute[72520]: </disk>
Aug 02 23:43:42 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] No VIF found with MAC fa:16:3e:0e:cc:95, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:43:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9f8e8571-beac-4d94-a538-1cdfd05d1f45 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.248s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:43 user nova-compute[72520]: INFO nova.compute.manager [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Detaching volume 6385428c-cfde-4eab-89ea-a8b25d48246f
Aug 02 23:43:43 user nova-compute[72520]: INFO nova.virt.block_device [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Attempting to driver detach volume 6385428c-cfde-4eab-89ea-a8b25d48246f from mountpoint /dev/vdb
Aug 02 23:43:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Attempting to detach device vdb from instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:43:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:43:43 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:43:43 user nova-compute[72520]:   <source dev="/dev/sde"/>
Aug 02 23:43:43 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:43:43 user nova-compute[72520]:   <serial>6385428c-cfde-4eab-89ea-a8b25d48246f</serial>
Aug 02 23:43:43 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:43:43 user nova-compute[72520]: </disk>
Aug 02 23:43:43 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:43:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully detached device vdb from instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 from the persistent domain config.
Aug 02 23:43:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:43:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:43:43 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:43:43 user nova-compute[72520]:   <source dev="/dev/sde"/>
Aug 02 23:43:43 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:43:43 user nova-compute[72520]:   <serial>6385428c-cfde-4eab-89ea-a8b25d48246f</serial>
Aug 02 23:43:43 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:43:43 user nova-compute[72520]: </disk>
Aug 02 23:43:43 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019824.3307204, 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:43:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully detached device vdb from instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 from the live domain config.
Aug 02 23:43:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTWIzRXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:43:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3b634-c97d-42dc-bb21-b7c9bad75eeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fe3703-faa5-4721-a781-022d1b13ebcf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:43:44 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:43:44 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:43:44 user nova-compute[72520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f (non-flash)
Aug 02 23:43:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:43:44 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:43:44 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:43:44 user nova-compute[72520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f (non-flash)
Aug 02 23:43:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc1217e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f'): ({'sde'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Removing single pathed devices sde {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692af5e-9070-436e-85d4-defa3e0cc351]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[017a379c-ecda-4200-a568-9b583a0aacb3]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Flushing IO for device /dev/sde {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ca6c7-a71c-43c4-9c44-50c8e4a1776c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2aa72-7a52-49cd-8f69-c59ca01342fc]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] SCSI volumes sde have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[571a0af5-203c-427b-a80c-8d6461c9cf40]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[589c1f00-b40b-4a32-b0ba-d7a6909a99c8]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260]
Aug 02 23:43:44 user nova-compute[72520]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f, portal: 172.16.0.220,3260] successful.
Aug 02 23:43:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6385428c-cfde-4eab-89ea-a8b25d48246f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc561df0-e5cc-4eb0-b6f9-19c3ab774c19]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] <== disconnect_volume: return (285ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:43:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:43:45 user nova-compute[72520]: DEBUG nova.objects.instance [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'flavor' on Instance uuid 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:43:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-95cb93a2-c8bf-442f-9f61-cc721454e0c3 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:47 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:43:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:43:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:43:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:43:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updating instance_info_cache with network_info: [{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:43:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:43:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:43:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:43:56 user nova-compute[72520]: INFO nova.compute.claims [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Claim successful on node user
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:43:57 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:43:57 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7992MB free_disk=25.337886810302734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.872s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.122s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:43:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.policy [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46d8df04adff403a8de2a6d65105ea54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097d7a8bab8c4be1810caead9bcd694e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:43:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Creating image(s)
Aug 02 23:43:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "/opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "/opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk 1073741824" returned: 0 in 0.050s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Cannot resize image /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'migration_context' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Successfully created port: fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Ensure instance console log exists: /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:43:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Successfully updated port: fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquired lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-changed-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Refreshing instance network info cache due to event network-changed-fca7da38-cf03-4628-862b-ae1e22fcb32a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] Acquiring lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updating instance_info_cache with network_info: [{"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Releasing lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Instance network_info: |[{"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] Acquired lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Refreshing network info cache for port fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Start _get_guest_xml network_info=[{"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:43:59 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:43:59 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1709175793',display_name='tempest-TestServerVolumeAttachmentScenario-server-1709175793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1709175793',id=25,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/gYIGVxNrPEpP3rshv7DkgQgNcAdIc6YU1V1Sj9zpDGXo1hGb5OA44tI4In8Jh4G9jc5hSaAY1nOfV35KtdeJBOBGCcMAClnvZ37Up1pXYkXD1gNha4RJpVwlYpKdFgQ==',key_name='tempest-keypair-54782840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097d7a8bab8c4be1810caead9bcd694e',ramdisk_id='',reservation_id='r-oi0f0suh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1176961382',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1176961382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46d8df04adff403a8de2a6d65105ea54',uuid=b9e778a7-58f6-4d25-bfbe-90777bd14b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Converting VIF {"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:28,bridge_name='br-int',has_traffic_filtering=True,id=fca7da38-cf03-4628-862b-ae1e22fcb32a,network=Network(308141b1-8f6c-4c6d-ab2d-440289fda6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca7da38-cf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'pci_devices' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:43:59 user nova-compute[72520]:   <uuid>b9e778a7-58f6-4d25-bfbe-90777bd14b89</uuid>
Aug 02 23:43:59 user nova-compute[72520]:   <name>instance-00000019</name>
Aug 02 23:43:59 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:43:59 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:43:59 user nova-compute[72520]:   <metadata>
Aug 02 23:43:59 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:43:59 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:43:59 user nova-compute[72520]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1709175793</nova:name>
Aug 02 23:43:59 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:43:59</nova:creationTime>
Aug 02 23:43:59 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:43:59 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:43:59 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:43:59 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:43:59 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:43:59 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:43:59 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:43:59 user nova-compute[72520]:       <nova:owner>
Aug 02 23:43:59 user nova-compute[72520]:         <nova:user uuid="46d8df04adff403a8de2a6d65105ea54">tempest-TestServerVolumeAttachmentScenario-1176961382-project-member</nova:user>
Aug 02 23:43:59 user nova-compute[72520]:         <nova:project uuid="097d7a8bab8c4be1810caead9bcd694e">tempest-TestServerVolumeAttachmentScenario-1176961382</nova:project>
Aug 02 23:43:59 user nova-compute[72520]:       </nova:owner>
Aug 02 23:43:59 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:43:59 user nova-compute[72520]:       <nova:ports>
Aug 02 23:43:59 user nova-compute[72520]:         <nova:port uuid="fca7da38-cf03-4628-862b-ae1e22fcb32a">
Aug 02 23:43:59 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 02 23:43:59 user nova-compute[72520]:         </nova:port>
Aug 02 23:43:59 user nova-compute[72520]:       </nova:ports>
Aug 02 23:43:59 user nova-compute[72520]:     </nova:instance>
Aug 02 23:43:59 user nova-compute[72520]:   </metadata>
Aug 02 23:43:59 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:43:59 user nova-compute[72520]:     <system>
Aug 02 23:43:59 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:43:59 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:43:59 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:43:59 user nova-compute[72520]:       <entry name="serial">b9e778a7-58f6-4d25-bfbe-90777bd14b89</entry>
Aug 02 23:43:59 user nova-compute[72520]:       <entry name="uuid">b9e778a7-58f6-4d25-bfbe-90777bd14b89</entry>
Aug 02 23:43:59 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:43:59 user nova-compute[72520]:     </system>
Aug 02 23:43:59 user nova-compute[72520]:   </sysinfo>
Aug 02 23:43:59 user nova-compute[72520]:   <os>
Aug 02 23:43:59 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:43:59 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:43:59 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:43:59 user nova-compute[72520]:   </os>
Aug 02 23:43:59 user nova-compute[72520]:   <features>
Aug 02 23:43:59 user nova-compute[72520]:     <acpi/>
Aug 02 23:43:59 user nova-compute[72520]:     <apic/>
Aug 02 23:43:59 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:43:59 user nova-compute[72520]:   </features>
Aug 02 23:43:59 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:43:59 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:43:59 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:43:59 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:43:59 user nova-compute[72520]:   </clock>
Aug 02 23:43:59 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:43:59 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:43:59 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:43:59 user nova-compute[72520]:   </cpu>
Aug 02 23:43:59 user nova-compute[72520]:   <devices>
Aug 02 23:43:59 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:43:59 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:43:59 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk"/>
Aug 02 23:43:59 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:43:59 user nova-compute[72520]:     </disk>
Aug 02 23:43:59 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:43:59 user nova-compute[72520]:       <mac address="fa:16:3e:e0:e5:28"/>
Aug 02 23:43:59 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:43:59 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:43:59 user nova-compute[72520]:       <target dev="tapfca7da38-cf"/>
Aug 02 23:43:59 user nova-compute[72520]:     </interface>
Aug 02 23:43:59 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:43:59 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/console.log" append="off"/>
Aug 02 23:43:59 user nova-compute[72520]:     </serial>
Aug 02 23:43:59 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:43:59 user nova-compute[72520]:     <video>
Aug 02 23:43:59 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:43:59 user nova-compute[72520]:     </video>
Aug 02 23:43:59 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:43:59 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:43:59 user nova-compute[72520]:     </rng>
Aug 02 23:43:59 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:43:59 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:43:59 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:43:59 user nova-compute[72520]:     </memballoon>
Aug 02 23:43:59 user nova-compute[72520]:   </devices>
Aug 02 23:43:59 user nova-compute[72520]: </domain>
Aug 02 23:43:59 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1709175793',display_name='tempest-TestServerVolumeAttachmentScenario-server-1709175793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1709175793',id=25,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/gYIGVxNrPEpP3rshv7DkgQgNcAdIc6YU1V1Sj9zpDGXo1hGb5OA44tI4In8Jh4G9jc5hSaAY1nOfV35KtdeJBOBGCcMAClnvZ37Up1pXYkXD1gNha4RJpVwlYpKdFgQ==',key_name='tempest-keypair-54782840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097d7a8bab8c4be1810caead9bcd694e',ramdisk_id='',reservation_id='r-oi0f0suh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1176961382',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1176961382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46d8df04adff403a8de2a6d65105ea54',uuid=b9e778a7-58f6-4d25-bfbe-90777bd14b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Converting VIF {"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:28,bridge_name='br-int',has_traffic_filtering=True,id=fca7da38-cf03-4628-862b-ae1e22fcb32a,network=Network(308141b1-8f6c-4c6d-ab2d-440289fda6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca7da38-cf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG os_vif [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:28,bridge_name='br-int',has_traffic_filtering=True,id=fca7da38-cf03-4628-862b-ae1e22fcb32a,network=Network(308141b1-8f6c-4c6d-ab2d-440289fda6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca7da38-cf') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfca7da38-cf, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfca7da38-cf, col_values=(('external_ids', {'iface-id': 'fca7da38-cf03-4628-862b-ae1e22fcb32a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e5:28', 'vm-uuid': 'b9e778a7-58f6-4d25-bfbe-90777bd14b89'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:43:59 user nova-compute[72520]: INFO os_vif [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:28,bridge_name='br-int',has_traffic_filtering=True,id=fca7da38-cf03-4628-862b-ae1e22fcb32a,network=Network(308141b1-8f6c-4c6d-ab2d-440289fda6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca7da38-cf')
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:43:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No VIF found with MAC fa:16:3e:e0:e5:28, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:44:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updated VIF entry in instance network info cache for port fca7da38-cf03-4628-862b-ae1e22fcb32a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:44:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updating instance_info_cache with network_info: [{"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:44:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c20a3536-02dd-4534-b12c-83f9b634a583 req-065190a7-d024-4855-843a-9c0330f14ac5 service nova] Releasing lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-a02e6e4c-3fec-44f5-b24b-e987da60651d req-39f5d711-e65d-4fe4-8214-44d11ad765d4 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a02e6e4c-3fec-44f5-b24b-e987da60651d req-39f5d711-e65d-4fe4-8214-44d11ad765d4 service nova] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a02e6e4c-3fec-44f5-b24b-e987da60651d req-39f5d711-e65d-4fe4-8214-44d11ad765d4 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a02e6e4c-3fec-44f5-b24b-e987da60651d req-39f5d711-e65d-4fe4-8214-44d11ad765d4 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-a02e6e4c-3fec-44f5-b24b-e987da60651d req-39f5d711-e65d-4fe4-8214-44d11ad765d4 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] No waiting events found dispatching network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:01 user nova-compute[72520]: WARNING nova.compute.manager [req-a02e6e4c-3fec-44f5-b24b-e987da60651d req-39f5d711-e65d-4fe4-8214-44d11ad765d4 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received unexpected event network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a for instance with vm_state building and task_state spawning.
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019843.2228959, b9e778a7-58f6-4d25-bfbe-90777bd14b89 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:44:03 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] VM Resumed (Lifecycle Event)
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:44:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Instance spawned successfully.
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:44:03 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019843.2240827, b9e778a7-58f6-4d25-bfbe-90777bd14b89 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:44:03 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] VM Started (Lifecycle Event)
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:44:03 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:44:03 user nova-compute[72520]: INFO nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:44:03 user nova-compute[72520]: INFO nova.compute.manager [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Took 6.69 seconds to build instance.
Aug 02 23:44:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b161890d-89e6-48f4-9247-da6cb1123183 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.793s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-ed1bc05c-c76f-46ff-9391-d90ea6e723b2 req-e2418b80-a5ad-4bab-8388-189f16ac8d84 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ed1bc05c-c76f-46ff-9391-d90ea6e723b2 req-e2418b80-a5ad-4bab-8388-189f16ac8d84 service nova] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ed1bc05c-c76f-46ff-9391-d90ea6e723b2 req-e2418b80-a5ad-4bab-8388-189f16ac8d84 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ed1bc05c-c76f-46ff-9391-d90ea6e723b2 req-e2418b80-a5ad-4bab-8388-189f16ac8d84 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-ed1bc05c-c76f-46ff-9391-d90ea6e723b2 req-e2418b80-a5ad-4bab-8388-189f16ac8d84 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] No waiting events found dispatching network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:03 user nova-compute[72520]: WARNING nova.compute.manager [req-ed1bc05c-c76f-46ff-9391-d90ea6e723b2 req-e2418b80-a5ad-4bab-8388-189f16ac8d84 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received unexpected event network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a for instance with vm_state active and task_state None.
Aug 02 23:44:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:44:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:26 user nova-compute[72520]: INFO nova.compute.manager [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Unrescuing
Aug 02 23:44:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:44:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquired lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:44:26 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Releasing lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG nova.objects.instance [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'flavor' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-0e38788b-cee4-46cf-a27a-05dca6ca55ea req-c79588ab-3a87-4ecb-963b-1296887718dc service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0e38788b-cee4-46cf-a27a-05dca6ca55ea req-c79588ab-3a87-4ecb-963b-1296887718dc service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0e38788b-cee4-46cf-a27a-05dca6ca55ea req-c79588ab-3a87-4ecb-963b-1296887718dc service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0e38788b-cee4-46cf-a27a-05dca6ca55ea req-c79588ab-3a87-4ecb-963b-1296887718dc service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-0e38788b-cee4-46cf-a27a-05dca6ca55ea req-c79588ab-3a87-4ecb-963b-1296887718dc service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:27 user nova-compute[72520]: WARNING nova.compute.manager [req-0e38788b-cee4-46cf-a27a-05dca6ca55ea req-c79588ab-3a87-4ecb-963b-1296887718dc service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:44:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing instance network info cache due to event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] Acquiring lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] Acquired lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:44:27 user nova-compute[72520]: DEBUG nova.network.neutron [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:44:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance destroyed successfully.
Aug 02 23:44:28 user nova-compute[72520]: DEBUG nova.network.neutron [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updated VIF entry in instance network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:44:28 user nova-compute[72520]: DEBUG nova.network.neutron [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:44:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-101bf8c5-9a37-4b6f-a5ea-af69a6ad0294 req-1e6c879a-aeda-4df0-a1e5-13e42063d623 service nova] Releasing lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:44:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-1faf31b5-797c-49a9-9508-2f80fc7bf375 req-c352a0b7-1142-48be-b04b-2ce497f94c79 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1faf31b5-797c-49a9-9508-2f80fc7bf375 req-c352a0b7-1142-48be-b04b-2ce497f94c79 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1faf31b5-797c-49a9-9508-2f80fc7bf375 req-c352a0b7-1142-48be-b04b-2ce497f94c79 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1faf31b5-797c-49a9-9508-2f80fc7bf375 req-c352a0b7-1142-48be-b04b-2ce497f94c79 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-1faf31b5-797c-49a9-9508-2f80fc7bf375 req-c352a0b7-1142-48be-b04b-2ce497f94c79 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:29 user nova-compute[72520]: WARNING nova.compute.manager [req-1faf31b5-797c-49a9-9508-2f80fc7bf375 req-c352a0b7-1142-48be-b04b-2ce497f94c79 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing instance network info cache due to event network-changed-1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] Acquiring lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] Acquired lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG nova.network.neutron [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Refreshing network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updated VIF entry in instance network info cache for port 1b164377-0056-4bbd-9be0-9c22a46148b6. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:44:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [{"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:44:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bd8a1732-8d3b-42a4-9686-023b88b54628 req-5aa1add7-3cc5-42fb-a5bc-f9cfdc8ff423 service nova] Releasing lock "refresh_cache-446c2a07-5fa9-441c-96d8-36d0ca812d1b" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for 446c2a07-5fa9-441c-96d8-36d0ca812d1b due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019871.4920683, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:44:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] VM Resumed (Lifecycle Event)
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cc6e11fa-12d6-477f-94b6-b0b5c50db124 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:44:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019871.4930756, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:44:31 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] VM Started (Lifecycle Event)
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:31 user nova-compute[72520]: WARNING nova.compute.manager [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:31 user nova-compute[72520]: WARNING nova.compute.manager [req-0fda6162-f6a3-4de2-8450-cee91c5454df req-a0508dd1-0ad6-44ea-9d65-e2ad9491c122 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:44:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:44:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:34 user nova-compute[72520]: INFO nova.compute.manager [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Terminating instance
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-1253613c-0860-4beb-ad7d-9443f7306463 req-80318d98-61ce-46fd-91e5-92c208f88212 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-vif-unplugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1253613c-0860-4beb-ad7d-9443f7306463 req-80318d98-61ce-46fd-91e5-92c208f88212 service nova] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1253613c-0860-4beb-ad7d-9443f7306463 req-80318d98-61ce-46fd-91e5-92c208f88212 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1253613c-0860-4beb-ad7d-9443f7306463 req-80318d98-61ce-46fd-91e5-92c208f88212 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-1253613c-0860-4beb-ad7d-9443f7306463 req-80318d98-61ce-46fd-91e5-92c208f88212 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] No waiting events found dispatching network-vif-unplugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-1253613c-0860-4beb-ad7d-9443f7306463 req-80318d98-61ce-46fd-91e5-92c208f88212 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-vif-unplugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Instance destroyed successfully.
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lazy-loading 'resources' on Instance uuid 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1978714043',display_name='tempest-AttachVolumeNegativeTest-server-1978714043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1978714043',id=24,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZNU27nOdvfE4WKtIl4YzfdziX0Wn6i9Shb8wo1vcBQcMMTUqi413bkyL8VsMP9ssX1/QOoIOnNkB5W3JwG6CbNu+CqMSyIjbMXEDkuYhxBsXkQUFNhUv+IQC2tCpopPQ==',key_name='tempest-keypair-543522041',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9052da981a9a4629b46fb0d3533c96c7',ramdisk_id='',reservation_id='r-qz36xf2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1376380752',owner_user_name='tempest-AttachVolumeNegativeTest-1376380752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9f79446d734cbfa7644b128bbf5275',uuid=2d82b6da-b401-4326-bfef-6e9a5e4f9bb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converting VIF {"id": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "address": "fa:16:3e:0e:cc:95", "network": {"id": "b14f9e4b-d7e0-48e7-83ed-169904106647", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1942041845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9052da981a9a4629b46fb0d3533c96c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa416bd60-1c", "ovs_interfaceid": "a416bd60-1ce5-4b6b-b4c9-f530f63d0a42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=a416bd60-1ce5-4b6b-b4c9-f530f63d0a42,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa416bd60-1c') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG os_vif [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=a416bd60-1ce5-4b6b-b4c9-f530f63d0a42,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa416bd60-1c') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa416bd60-1c, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:34 user nova-compute[72520]: INFO os_vif [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=a416bd60-1ce5-4b6b-b4c9-f530f63d0a42,network=Network(b14f9e4b-d7e0-48e7-83ed-169904106647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa416bd60-1c')
Aug 02 23:44:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Deleting instance files /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4_del
Aug 02 23:44:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Deletion of /opt/stack/data/nova/instances/2d82b6da-b401-4326-bfef-6e9a5e4f9bb4_del complete
Aug 02 23:44:34 user nova-compute[72520]: INFO nova.compute.manager [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 02 23:44:34 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:44:34 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:44:35 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:44:35 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Took 0.92 seconds to deallocate network for instance.
Aug 02 23:44:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:36 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Deleted allocations for instance 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4
Aug 02 23:44:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-fba84bef-9684-4373-8404-e4ea1b181340 tempest-AttachVolumeNegativeTest-1376380752 tempest-AttachVolumeNegativeTest-1376380752-project-member] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.222s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-2c708f89-c2c7-4462-88e4-c6add5338e81 req-bcc6e63e-43e0-4b39-8fda-b781137fc651 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2c708f89-c2c7-4462-88e4-c6add5338e81 req-bcc6e63e-43e0-4b39-8fda-b781137fc651 service nova] Acquiring lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2c708f89-c2c7-4462-88e4-c6add5338e81 req-bcc6e63e-43e0-4b39-8fda-b781137fc651 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2c708f89-c2c7-4462-88e4-c6add5338e81 req-bcc6e63e-43e0-4b39-8fda-b781137fc651 service nova] Lock "2d82b6da-b401-4326-bfef-6e9a5e4f9bb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-2c708f89-c2c7-4462-88e4-c6add5338e81 req-bcc6e63e-43e0-4b39-8fda-b781137fc651 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] No waiting events found dispatching network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:44:36 user nova-compute[72520]: WARNING nova.compute.manager [req-2c708f89-c2c7-4462-88e4-c6add5338e81 req-bcc6e63e-43e0-4b39-8fda-b781137fc651 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received unexpected event network-vif-plugged-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 for instance with vm_state deleted and task_state None.
Aug 02 23:44:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-2c708f89-c2c7-4462-88e4-c6add5338e81 req-bcc6e63e-43e0-4b39-8fda-b781137fc651 service nova] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Received event network-vif-deleted-a416bd60-1ce5-4b6b-b4c9-f530f63d0a42 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:44:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updating instance_info_cache with network_info: [{"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019874.893391, 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:44:49 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] VM Stopped (Lifecycle Event)
Aug 02 23:44:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e50f45ba-5f94-478d-ad47-fbe74fa28408 None None] [instance: 2d82b6da-b401-4326-bfef-6e9a5e4f9bb4] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:44:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:53 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:44:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:44:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:44:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8035MB free_disk=25.336265563964844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:44:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:44:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:44:59 user nova-compute[72520]: INFO nova.compute.manager [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Detaching volume bcd70029-053c-4e74-a20b-7d41eccdebfa
Aug 02 23:44:59 user nova-compute[72520]: INFO nova.virt.block_device [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Attempting to driver detach volume bcd70029-053c-4e74-a20b-7d41eccdebfa from mountpoint /dev/vdb
Aug 02 23:44:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Attempting to detach device vdb from instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:44:59 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:44:59 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:44:59 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:44:59 user nova-compute[72520]:   <serial>bcd70029-053c-4e74-a20b-7d41eccdebfa</serial>
Aug 02 23:44:59 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:44:59 user nova-compute[72520]: </disk>
Aug 02 23:44:59 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:44:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Successfully detached device vdb from instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b from the persistent domain config.
Aug 02 23:44:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:44:59 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:44:59 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:44:59 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:44:59 user nova-compute[72520]:   <serial>bcd70029-053c-4e74-a20b-7d41eccdebfa</serial>
Aug 02 23:44:59 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:44:59 user nova-compute[72520]: </disk>
Aug 02 23:44:59 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:44:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019900.169761, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:45:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Successfully detached device vdb from instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b from the live domain config.
Aug 02 23:45:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmqJcaBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:45:00 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[423cd27f-cbff-478d-8ac6-a23ad555bd18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4f2f23-e26d-42a5-8822-871c1647770b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:45:00 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:45:00 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:45:00 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:45:00 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:45:00 user nova-compute[72520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa (non-flash)
Aug 02 23:45:00 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4185e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8f64d8-7f9f-4da5-abef-87f0efd112c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f4b234-ee7f-4930-b526-9942119f1345]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a83e9fb-1890-4079-b232-1fe171f75809]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c12b3-70aa-4237-96f1-4b548ec12898]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dbbbb8-329b-43ee-9528-44fde568df36]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0595e374-7087-424b-ba73-a4e321faef00]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260]
Aug 02 23:45:00 user nova-compute[72520]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa, portal: 172.16.0.220,3260] successful.
Aug 02 23:45:00 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd70029-053c-4e74-a20b-7d41eccdebfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87da546-4765-4389-86b0-c81fb7de7d55]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] <== disconnect_volume: return (292ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:45:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:45:01 user nova-compute[72520]: DEBUG nova.objects.instance [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'flavor' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-82aa84cc-de36-4d92-ad7a-af2149c21fca tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.615s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:45:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:03 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:45:03 user nova-compute[72520]: INFO nova.compute.claims [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Claim successful on node user
Aug 02 23:45:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:45:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.policy [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd02269696a0d47738d8daa53d44b3b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb887059a9634cce9f17319a980a18f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:45:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Creating image(s)
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk 1073741824" returned: 0 in 0.047s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Cannot resize image /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.objects.instance [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'migration_context' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Ensure instance console log exists: /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:05 user nova-compute[72520]: DEBUG nova.network.neutron [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Successfully created port: 005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Successfully updated port: 005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing instance network info cache due to event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] Acquiring lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance network_info: |[{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] Acquired lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Start _get_guest_xml network_info=[{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:45:06 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:45:06 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405470045',display_name='tempest-ServerRescueNegativeTestJSON-server-405470045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405470045',id=26,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPmJC3+jJREMbo4vqNbPCJGeywe1JSNQOWoUCi6p5IcE2cNco4Oup4a9sV89yRuXDMgmdqQUXimUmNv/DaDPrAMItkd3457w7kS79ih+4k6SjV+YEljCzGCexL9EtAIhw==',key_name='tempest-keypair-420863145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-elxyxg0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d02269696a0d47738d8daa53d44b3b70',uuid=e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'pci_devices' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:45:06 user nova-compute[72520]:   <uuid>e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8</uuid>
Aug 02 23:45:06 user nova-compute[72520]:   <name>instance-0000001a</name>
Aug 02 23:45:06 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:45:06 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:45:06 user nova-compute[72520]:   <metadata>
Aug 02 23:45:06 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:45:06 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:45:06 user nova-compute[72520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-405470045</nova:name>
Aug 02 23:45:06 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:45:06</nova:creationTime>
Aug 02 23:45:06 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:45:06 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:45:06 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:45:06 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:45:06 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:45:06 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:45:06 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:45:06 user nova-compute[72520]:       <nova:owner>
Aug 02 23:45:06 user nova-compute[72520]:         <nova:user uuid="d02269696a0d47738d8daa53d44b3b70">tempest-ServerRescueNegativeTestJSON-1442912244-project-member</nova:user>
Aug 02 23:45:06 user nova-compute[72520]:         <nova:project uuid="cb887059a9634cce9f17319a980a18f4">tempest-ServerRescueNegativeTestJSON-1442912244</nova:project>
Aug 02 23:45:06 user nova-compute[72520]:       </nova:owner>
Aug 02 23:45:06 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:45:06 user nova-compute[72520]:       <nova:ports>
Aug 02 23:45:06 user nova-compute[72520]:         <nova:port uuid="005e5e35-c836-4c41-99c6-e3233614ed8a">
Aug 02 23:45:06 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 02 23:45:06 user nova-compute[72520]:         </nova:port>
Aug 02 23:45:06 user nova-compute[72520]:       </nova:ports>
Aug 02 23:45:06 user nova-compute[72520]:     </nova:instance>
Aug 02 23:45:06 user nova-compute[72520]:   </metadata>
Aug 02 23:45:06 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:45:06 user nova-compute[72520]:     <system>
Aug 02 23:45:06 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:45:06 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:45:06 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:45:06 user nova-compute[72520]:       <entry name="serial">e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8</entry>
Aug 02 23:45:06 user nova-compute[72520]:       <entry name="uuid">e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8</entry>
Aug 02 23:45:06 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:45:06 user nova-compute[72520]:     </system>
Aug 02 23:45:06 user nova-compute[72520]:   </sysinfo>
Aug 02 23:45:06 user nova-compute[72520]:   <os>
Aug 02 23:45:06 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:45:06 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:45:06 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:45:06 user nova-compute[72520]:   </os>
Aug 02 23:45:06 user nova-compute[72520]:   <features>
Aug 02 23:45:06 user nova-compute[72520]:     <acpi/>
Aug 02 23:45:06 user nova-compute[72520]:     <apic/>
Aug 02 23:45:06 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:45:06 user nova-compute[72520]:   </features>
Aug 02 23:45:06 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:45:06 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:45:06 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:45:06 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:45:06 user nova-compute[72520]:   </clock>
Aug 02 23:45:06 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:45:06 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:45:06 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:45:06 user nova-compute[72520]:   </cpu>
Aug 02 23:45:06 user nova-compute[72520]:   <devices>
Aug 02 23:45:06 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:45:06 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:45:06 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk"/>
Aug 02 23:45:06 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:45:06 user nova-compute[72520]:     </disk>
Aug 02 23:45:06 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:45:06 user nova-compute[72520]:       <mac address="fa:16:3e:42:5f:c4"/>
Aug 02 23:45:06 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:45:06 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:45:06 user nova-compute[72520]:       <target dev="tap005e5e35-c8"/>
Aug 02 23:45:06 user nova-compute[72520]:     </interface>
Aug 02 23:45:06 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:45:06 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/console.log" append="off"/>
Aug 02 23:45:06 user nova-compute[72520]:     </serial>
Aug 02 23:45:06 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:45:06 user nova-compute[72520]:     <video>
Aug 02 23:45:06 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:45:06 user nova-compute[72520]:     </video>
Aug 02 23:45:06 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:45:06 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:45:06 user nova-compute[72520]:     </rng>
Aug 02 23:45:06 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:45:06 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:45:06 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:45:06 user nova-compute[72520]:     </memballoon>
Aug 02 23:45:06 user nova-compute[72520]:   </devices>
Aug 02 23:45:06 user nova-compute[72520]: </domain>
Aug 02 23:45:06 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405470045',display_name='tempest-ServerRescueNegativeTestJSON-server-405470045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405470045',id=26,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPmJC3+jJREMbo4vqNbPCJGeywe1JSNQOWoUCi6p5IcE2cNco4Oup4a9sV89yRuXDMgmdqQUXimUmNv/DaDPrAMItkd3457w7kS79ih+4k6SjV+YEljCzGCexL9EtAIhw==',key_name='tempest-keypair-420863145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-elxyxg0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d02269696a0d47738d8daa53d44b3b70',uuid=e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG os_vif [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap005e5e35-c8, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap005e5e35-c8, col_values=(('external_ids', {'iface-id': '005e5e35-c836-4c41-99c6-e3233614ed8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:5f:c4', 'vm-uuid': 'e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:06 user nova-compute[72520]: INFO os_vif [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8')
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No VIF found with MAC fa:16:3e:42:5f:c4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updated VIF entry in instance network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:45:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a337a47-731c-4724-814c-85e35e0c64af req-ae162380-dd18-4308-ab8c-2d2744e1b2a2 service nova] Releasing lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-e043d47a-ab93-4c77-be06-8010b768e2a7 req-fca0c18b-c816-4a3e-82b8-9fbcb2e69c6a service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e043d47a-ab93-4c77-be06-8010b768e2a7 req-fca0c18b-c816-4a3e-82b8-9fbcb2e69c6a service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e043d47a-ab93-4c77-be06-8010b768e2a7 req-fca0c18b-c816-4a3e-82b8-9fbcb2e69c6a service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e043d47a-ab93-4c77-be06-8010b768e2a7 req-fca0c18b-c816-4a3e-82b8-9fbcb2e69c6a service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-e043d47a-ab93-4c77-be06-8010b768e2a7 req-fca0c18b-c816-4a3e-82b8-9fbcb2e69c6a service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:45:08 user nova-compute[72520]: WARNING nova.compute.manager [req-e043d47a-ab93-4c77-be06-8010b768e2a7 req-fca0c18b-c816-4a3e-82b8-9fbcb2e69c6a service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state building and task_state spawning.
Aug 02 23:45:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:09 user nova-compute[72520]: INFO nova.compute.manager [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Detaching volume a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5
Aug 02 23:45:09 user nova-compute[72520]: INFO nova.virt.block_device [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Attempting to driver detach volume a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 from mountpoint /dev/vdb
Aug 02 23:45:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Attempting to detach device vdb from instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:45:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:45:09 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:45:09 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:45:09 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:45:09 user nova-compute[72520]:   <serial>a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5</serial>
Aug 02 23:45:09 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 02 23:45:09 user nova-compute[72520]: </disk>
Aug 02 23:45:09 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:45:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully detached device vdb from instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac from the persistent domain config.
Aug 02 23:45:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:45:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:45:09 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:45:09 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:45:09 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:45:09 user nova-compute[72520]:   <serial>a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5</serial>
Aug 02 23:45:09 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 02 23:45:09 user nova-compute[72520]: </disk>
Aug 02 23:45:09 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019910.042541, 6ca3c320-bf1c-43b5-973c-4d73b22487ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully detached device vdb from instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac from the live domain config.
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scUhPfMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:45:10 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[904438f4-ec2d-41c2-97a2-293ba61bbec3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc26079-38e0-4538-ab3d-f19b6227dbbe]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:45:10 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:45:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:45:10 user nova-compute[72520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 (non-flash)
Aug 02 23:45:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce427b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e93fd14-ebb5-4f11-bf55-3ae2ed9cc74c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe598032-d4c4-4131-91d3-dbc1452da8c9]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d731f-f3b0-4322-9e4d-7dfd38596af4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8d6ae-9030-414b-9ae4-8837abb16f6f]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d49d8c-a139-4cb8-8369-f9a403354b74]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d2550e-b1f2-40bb-9b35-e7a10ab8ff55]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260]
Aug 02 23:45:10 user nova-compute[72520]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5, portal: 172.16.0.220,3260] successful.
Aug 02 23:45:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c0ca20-6e51-4d7c-afea-36e4cb1c19b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579da8d-65a0-42f6-b4d3-171b69e54a8a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== disconnect_volume: return (266ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019910.4286032, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] VM Resumed (Lifecycle Event)
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance spawned successfully.
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-74493ce8-7881-4fd0-b3d1-5d712f481626 req-be307fa4-97a4-4e9e-9662-fd1360869924 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74493ce8-7881-4fd0-b3d1-5d712f481626 req-be307fa4-97a4-4e9e-9662-fd1360869924 service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74493ce8-7881-4fd0-b3d1-5d712f481626 req-be307fa4-97a4-4e9e-9662-fd1360869924 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-74493ce8-7881-4fd0-b3d1-5d712f481626 req-be307fa4-97a4-4e9e-9662-fd1360869924 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-74493ce8-7881-4fd0-b3d1-5d712f481626 req-be307fa4-97a4-4e9e-9662-fd1360869924 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:45:10 user nova-compute[72520]: WARNING nova.compute.manager [req-74493ce8-7881-4fd0-b3d1-5d712f481626 req-be307fa4-97a4-4e9e-9662-fd1360869924 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state building and task_state spawning.
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019910.4302762, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] VM Started (Lifecycle Event)
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 02 23:45:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:45:10 user nova-compute[72520]: INFO nova.compute.manager [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Took 6.94 seconds to build instance.
Aug 02 23:45:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-010388ea-50d2-40df-be9e-9b7b5960d997 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.037s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'flavor' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:45:11 user nova-compute[72520]: INFO nova.compute.claims [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Claim successful on node user
Aug 02 23:45:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-45ced106-ff03-4b6a-84f1-3374ffa80200 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:11 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:45:11 user nova-compute[72520]: DEBUG nova.policy [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3ecb56ac3554ee3b1ef658d9cdd3869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542e5ab2d59245f58d357cf688e30a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:45:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Creating image(s)
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "/opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.167s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk 1073741824" returned: 0 in 0.059s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Successfully created port: 8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Cannot resize image /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'migration_context' on Instance uuid 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Ensure instance console log exists: /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Successfully updated port: 8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received event network-changed-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Refreshing instance network info cache due to event network-changed-8ee0bd7f-3935-4dd9-947e-055bae95b5d9. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] Acquiring lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Updating instance_info_cache with network_info: [{"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Instance network_info: |[{"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] Acquired lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Refreshing network info cache for port 8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Start _get_guest_xml network_info=[{"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:45:13 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:45:13 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-939994510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-939994510',id=27,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-0vi1j2zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:45:12Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=919bee8c-1b0c-4d57-9eda-a9b83d4d3b19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:aa:36,bridge_name='br-int',has_traffic_filtering=True,id=8ee0bd7f-3935-4dd9-947e-055bae95b5d9,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee0bd7f-39') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'pci_devices' on Instance uuid 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:45:13 user nova-compute[72520]:   <uuid>919bee8c-1b0c-4d57-9eda-a9b83d4d3b19</uuid>
Aug 02 23:45:13 user nova-compute[72520]:   <name>instance-0000001b</name>
Aug 02 23:45:13 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:45:13 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:45:13 user nova-compute[72520]:   <metadata>
Aug 02 23:45:13 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:45:13 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:45:13 user nova-compute[72520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-939994510</nova:name>
Aug 02 23:45:13 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:45:13</nova:creationTime>
Aug 02 23:45:13 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:45:13 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:45:13 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:45:13 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:45:13 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:45:13 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:45:13 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:45:13 user nova-compute[72520]:       <nova:owner>
Aug 02 23:45:13 user nova-compute[72520]:         <nova:user uuid="f3ecb56ac3554ee3b1ef658d9cdd3869">tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member</nova:user>
Aug 02 23:45:13 user nova-compute[72520]:         <nova:project uuid="542e5ab2d59245f58d357cf688e30a43">tempest-ServerBootFromVolumeStableRescueTest-1108272558</nova:project>
Aug 02 23:45:13 user nova-compute[72520]:       </nova:owner>
Aug 02 23:45:13 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:45:13 user nova-compute[72520]:       <nova:ports>
Aug 02 23:45:13 user nova-compute[72520]:         <nova:port uuid="8ee0bd7f-3935-4dd9-947e-055bae95b5d9">
Aug 02 23:45:13 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 02 23:45:13 user nova-compute[72520]:         </nova:port>
Aug 02 23:45:13 user nova-compute[72520]:       </nova:ports>
Aug 02 23:45:13 user nova-compute[72520]:     </nova:instance>
Aug 02 23:45:13 user nova-compute[72520]:   </metadata>
Aug 02 23:45:13 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:45:13 user nova-compute[72520]:     <system>
Aug 02 23:45:13 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:45:13 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:45:13 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:45:13 user nova-compute[72520]:       <entry name="serial">919bee8c-1b0c-4d57-9eda-a9b83d4d3b19</entry>
Aug 02 23:45:13 user nova-compute[72520]:       <entry name="uuid">919bee8c-1b0c-4d57-9eda-a9b83d4d3b19</entry>
Aug 02 23:45:13 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:45:13 user nova-compute[72520]:     </system>
Aug 02 23:45:13 user nova-compute[72520]:   </sysinfo>
Aug 02 23:45:13 user nova-compute[72520]:   <os>
Aug 02 23:45:13 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:45:13 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:45:13 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:45:13 user nova-compute[72520]:   </os>
Aug 02 23:45:13 user nova-compute[72520]:   <features>
Aug 02 23:45:13 user nova-compute[72520]:     <acpi/>
Aug 02 23:45:13 user nova-compute[72520]:     <apic/>
Aug 02 23:45:13 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:45:13 user nova-compute[72520]:   </features>
Aug 02 23:45:13 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:45:13 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:45:13 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:45:13 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:45:13 user nova-compute[72520]:   </clock>
Aug 02 23:45:13 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:45:13 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:45:13 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:45:13 user nova-compute[72520]:   </cpu>
Aug 02 23:45:13 user nova-compute[72520]:   <devices>
Aug 02 23:45:13 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:45:13 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:45:13 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk"/>
Aug 02 23:45:13 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:45:13 user nova-compute[72520]:     </disk>
Aug 02 23:45:13 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:45:13 user nova-compute[72520]:       <mac address="fa:16:3e:5d:aa:36"/>
Aug 02 23:45:13 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:45:13 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:45:13 user nova-compute[72520]:       <target dev="tap8ee0bd7f-39"/>
Aug 02 23:45:13 user nova-compute[72520]:     </interface>
Aug 02 23:45:13 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:45:13 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/console.log" append="off"/>
Aug 02 23:45:13 user nova-compute[72520]:     </serial>
Aug 02 23:45:13 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:45:13 user nova-compute[72520]:     <video>
Aug 02 23:45:13 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:45:13 user nova-compute[72520]:     </video>
Aug 02 23:45:13 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:45:13 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:45:13 user nova-compute[72520]:     </rng>
Aug 02 23:45:13 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:45:13 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:45:13 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:45:13 user nova-compute[72520]:     </memballoon>
Aug 02 23:45:13 user nova-compute[72520]:   </devices>
Aug 02 23:45:13 user nova-compute[72520]: </domain>
Aug 02 23:45:13 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-939994510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-939994510',id=27,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-0vi1j2zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:45:12Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=919bee8c-1b0c-4d57-9eda-a9b83d4d3b19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:aa:36,bridge_name='br-int',has_traffic_filtering=True,id=8ee0bd7f-3935-4dd9-947e-055bae95b5d9,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee0bd7f-39') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG os_vif [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:aa:36,bridge_name='br-int',has_traffic_filtering=True,id=8ee0bd7f-3935-4dd9-947e-055bae95b5d9,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee0bd7f-39') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ee0bd7f-39, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ee0bd7f-39, col_values=(('external_ids', {'iface-id': '8ee0bd7f-3935-4dd9-947e-055bae95b5d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:aa:36', 'vm-uuid': '919bee8c-1b0c-4d57-9eda-a9b83d4d3b19'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:45:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:13 user nova-compute[72520]: INFO os_vif [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:aa:36,bridge_name='br-int',has_traffic_filtering=True,id=8ee0bd7f-3935-4dd9-947e-055bae95b5d9,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee0bd7f-39')
Aug 02 23:45:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:45:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No VIF found with MAC fa:16:3e:5d:aa:36, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:45:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Updated VIF entry in instance network info cache for port 8ee0bd7f-3935-4dd9-947e-055bae95b5d9. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:45:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Updating instance_info_cache with network_info: [{"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:45:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-234a32b2-741e-4ce8-9046-d9c0a8c9f06a req-6cc8245d-68ff-4534-940b-a5c040e1cf79 service nova] Releasing lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-c1713d04-b828-4141-a3d1-79b8bdbcd0b6 req-de00fcc4-ccba-4614-a6f1-69ba8e37a98d service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received event network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c1713d04-b828-4141-a3d1-79b8bdbcd0b6 req-de00fcc4-ccba-4614-a6f1-69ba8e37a98d service nova] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c1713d04-b828-4141-a3d1-79b8bdbcd0b6 req-de00fcc4-ccba-4614-a6f1-69ba8e37a98d service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c1713d04-b828-4141-a3d1-79b8bdbcd0b6 req-de00fcc4-ccba-4614-a6f1-69ba8e37a98d service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-c1713d04-b828-4141-a3d1-79b8bdbcd0b6 req-de00fcc4-ccba-4614-a6f1-69ba8e37a98d service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] No waiting events found dispatching network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:45:15 user nova-compute[72520]: WARNING nova.compute.manager [req-c1713d04-b828-4141-a3d1-79b8bdbcd0b6 req-de00fcc4-ccba-4614-a6f1-69ba8e37a98d service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received unexpected event network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 for instance with vm_state building and task_state spawning.
Aug 02 23:45:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019917.52424, 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:45:17 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] VM Resumed (Lifecycle Event)
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:45:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Instance spawned successfully.
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:45:17 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691019917.5257795, 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:45:17 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] VM Started (Lifecycle Event)
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:45:17 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:45:17 user nova-compute[72520]: INFO nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:45:17 user nova-compute[72520]: INFO nova.compute.manager [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Took 6.63 seconds to build instance.
Aug 02 23:45:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ea9d2d88-08e0-4566-82f7-8a2f309484ce tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.737s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-c20e3aac-4fd5-4c5b-8a9e-55ac171c7185 req-43d29146-0ba1-4fcc-9584-6eb491bb8af6 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received event network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c20e3aac-4fd5-4c5b-8a9e-55ac171c7185 req-43d29146-0ba1-4fcc-9584-6eb491bb8af6 service nova] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c20e3aac-4fd5-4c5b-8a9e-55ac171c7185 req-43d29146-0ba1-4fcc-9584-6eb491bb8af6 service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c20e3aac-4fd5-4c5b-8a9e-55ac171c7185 req-43d29146-0ba1-4fcc-9584-6eb491bb8af6 service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-c20e3aac-4fd5-4c5b-8a9e-55ac171c7185 req-43d29146-0ba1-4fcc-9584-6eb491bb8af6 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] No waiting events found dispatching network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:45:17 user nova-compute[72520]: WARNING nova.compute.manager [req-c20e3aac-4fd5-4c5b-8a9e-55ac171c7185 req-43d29146-0ba1-4fcc-9584-6eb491bb8af6 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received unexpected event network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 for instance with vm_state active and task_state None.
Aug 02 23:45:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:45:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-changed-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Refreshing instance network info cache due to event network-changed-fca7da38-cf03-4628-862b-ae1e22fcb32a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:45:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] Acquiring lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:45:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] Acquired lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:45:47 user nova-compute[72520]: DEBUG nova.network.neutron [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Refreshing network info cache for port fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG nova.network.neutron [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updated VIF entry in instance network info cache for port fca7da38-cf03-4628-862b-ae1e22fcb32a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG nova.network.neutron [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updating instance_info_cache with network_info: [{"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0bc44b1c-1f5e-42c5-ad99-1503cb1f6b1a req-401c9b06-28d4-4294-aebe-96d1fd02b4a5 service nova] Releasing lock "refresh_cache-b9e778a7-58f6-4d25-bfbe-90777bd14b89" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'flavor' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:48 user nova-compute[72520]: INFO nova.compute.manager [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Attaching volume b39ba453-7646-473f-9920-48c880e9805e to /dev/vdb
Aug 02 23:45:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG os_brick.utils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5253552e-45a3-4d01-ad33-b018bad3f9ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef7c24d-5c91-4ebb-abf5-f9ccf3707022]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa2d8e6-7ab5-478d-93b2-f769bb51703a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5d87eb-5713-4c30-b159-9f5f11159f0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:45:49 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3de9039-ff0e-4956-b637-5a4a90acea81]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG os_brick.utils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updating existing volume attachment record: f2454742-daf6-40ef-849e-356b21d56eed {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:45:49 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:50 user nova-compute[72520]: INFO nova.compute.manager [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Terminating instance
Aug 02 23:45:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4fb26ca2-a9f3-4169-b144-215c7812bc00 req-033ac8ec-8471-41b4-a256-a8cac329abdf service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4fb26ca2-a9f3-4169-b144-215c7812bc00 req-033ac8ec-8471-41b4-a256-a8cac329abdf service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4fb26ca2-a9f3-4169-b144-215c7812bc00 req-033ac8ec-8471-41b4-a256-a8cac329abdf service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4fb26ca2-a9f3-4169-b144-215c7812bc00 req-033ac8ec-8471-41b4-a256-a8cac329abdf service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4fb26ca2-a9f3-4169-b144-215c7812bc00 req-033ac8ec-8471-41b4-a256-a8cac329abdf service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:45:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-4fb26ca2-a9f3-4169-b144-215c7812bc00 req-033ac8ec-8471-41b4-a256-a8cac329abdf service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-unplugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:45:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Instance destroyed successfully.
Aug 02 23:45:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lazy-loading 'resources' on Instance uuid 446c2a07-5fa9-441c-96d8-36d0ca812d1b {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-14401138',display_name='tempest-ServerStableDeviceRescueTest-server-14401138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-14401138',id=21,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI99MH/yOy+zyw/6T3gBphmJlKu8fUQAHAInZKk9Q5NAwgz2XPB2/bm1r9zRCsg5BNmCXmkpBXDQlOfDONe6S8PzoZjf2BrdEcciBgaPD6dr7udYlbYRVCJm8xAxw05eng==',key_name='tempest-keypair-1607586224',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce093aec44554569978366f3d15b9674',ramdisk_id='',reservation_id='r-mlzy31o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-702900337',owner_user_name='tempest-ServerStableDeviceRescueTest-702900337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa5a76e9ec8400db509e46df8d3221e',uuid=446c2a07-5fa9-441c-96d8-36d0ca812d1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converting VIF {"id": "1b164377-0056-4bbd-9be0-9c22a46148b6", "address": "fa:16:3e:53:22:15", "network": {"id": "8bbe186a-435a-41b8-b366-71f0c85c4a95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1013323189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce093aec44554569978366f3d15b9674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b164377-00", "ovs_interfaceid": "1b164377-0056-4bbd-9be0-9c22a46148b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG os_vif [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b164377-00, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:45:51 user nova-compute[72520]: INFO os_vif [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:22:15,bridge_name='br-int',has_traffic_filtering=True,id=1b164377-0056-4bbd-9be0-9c22a46148b6,network=Network(8bbe186a-435a-41b8-b366-71f0c85c4a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b164377-00')
Aug 02 23:45:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Deleting instance files /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b_del
Aug 02 23:45:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Deletion of /opt/stack/data/nova/instances/446c2a07-5fa9-441c-96d8-36d0ca812d1b_del complete
Aug 02 23:45:51 user nova-compute[72520]: INFO nova.compute.manager [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 02 23:45:51 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:45:51 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:45:51 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Took 0.80 seconds to deallocate network for instance.
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:52 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Deleted allocations for instance 446c2a07-5fa9-441c-96d8-36d0ca812d1b
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aee44bf-3305-4e17-8a9b-48a7329cbb33 tempest-ServerStableDeviceRescueTest-702900337 tempest-ServerStableDeviceRescueTest-702900337-project-member] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-33dd8e76-5ab7-4302-b376-0d1bcf049e98 req-e258173d-e3e2-4140-942b-5fd450fb07f0 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33dd8e76-5ab7-4302-b376-0d1bcf049e98 req-e258173d-e3e2-4140-942b-5fd450fb07f0 service nova] Acquiring lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33dd8e76-5ab7-4302-b376-0d1bcf049e98 req-e258173d-e3e2-4140-942b-5fd450fb07f0 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33dd8e76-5ab7-4302-b376-0d1bcf049e98 req-e258173d-e3e2-4140-942b-5fd450fb07f0 service nova] Lock "446c2a07-5fa9-441c-96d8-36d0ca812d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-33dd8e76-5ab7-4302-b376-0d1bcf049e98 req-e258173d-e3e2-4140-942b-5fd450fb07f0 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] No waiting events found dispatching network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:45:52 user nova-compute[72520]: WARNING nova.compute.manager [req-33dd8e76-5ab7-4302-b376-0d1bcf049e98 req-e258173d-e3e2-4140-942b-5fd450fb07f0 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received unexpected event network-vif-plugged-1b164377-0056-4bbd-9be0-9c22a46148b6 for instance with vm_state deleted and task_state None.
Aug 02 23:45:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-33dd8e76-5ab7-4302-b376-0d1bcf049e98 req-e258173d-e3e2-4140-942b-5fd450fb07f0 service nova] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Received event network-vif-deleted-1b164377-0056-4bbd-9be0-9c22a46148b6 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:45:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:45:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:45:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:45:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7845MB free_disk=25.39383316040039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:45:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:45:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:45:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:46:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdETAWIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:46:01 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:46:01 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:46:01 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[08258cbf-b090-44d8-913c-ca49bf5fef8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:46:01 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[097c670f-9563-4eea-bdeb-4077cd6dc21f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e] added
Aug 02 23:46:01 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a080c-91c3-4caf-aef2-939c1fa5175f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53bd319-ff4e-4d0b-910a-91432a6e26fc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdETAWIF {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdETAWIF" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a57563-6b3b-4ea7-a22a-bc038250ffd8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HdETAWIF'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4b72b2-2548-4bf6-bc3e-7a53d3f99bb0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b9e5fb-229a-42b2-92fa-fef7eadfc0de]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:01 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:01 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df44da4c-55be-46ab-a057-b90ab41d8b02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260]
Aug 02 23:46:01 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260] successful.
Aug 02 23:46:01 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da76df6a-9746-4a30-a441-a7a06febc020]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[45da7773-0653-4321-82e2-6a77839fdd70]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:01 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:01 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:01 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:01 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6e86aa-0eb2-467e-b5ee-f5f73a65c9d0]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:01 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:46:02 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:46:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdETAWIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:46:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:46:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23035396232303432', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:46:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035396232303432', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:46:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'flavor' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:46:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:46:02 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:46:02 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:46:02 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:46:02 user nova-compute[72520]:   <serial>b39ba453-7646-473f-9920-48c880e9805e</serial>
Aug 02 23:46:02 user nova-compute[72520]: </disk>
Aug 02 23:46:02 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:46:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:46:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:46:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No VIF found with MAC fa:16:3e:e0:e5:28, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:46:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5ea99db7-8651-488f-864e-de0a33cd0e5b tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.345s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:46:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691019951.060227, 446c2a07-5fa9-441c-96d8-36d0ca812d1b => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:46:06 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] VM Stopped (Lifecycle Event)
Aug 02 23:46:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d33006a6-4c18-4ec6-b508-6ac71522d55e None None] [instance: 446c2a07-5fa9-441c-96d8-36d0ca812d1b] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'flavor' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:46:06 user nova-compute[72520]: INFO nova.compute.manager [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Attaching volume e7a0b615-777d-4c79-851b-c77f893aa7fc to /dev/vdc
Aug 02 23:46:06 user nova-compute[72520]: DEBUG os_brick.utils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c043d557-5ec1-4ab4-9460-81781eada3ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da12306-f6b2-4292-bc2f-c8cd7ec98f49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[55060cbe-c3ee-4645-9569-7ad291bf06a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e9499-5673-473c-a757-6c62b25ee334]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:46:06 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:46:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f22747-4a99-4666-97ec-0e9b22fbe876]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG os_brick.utils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:46:06 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updating existing volume attachment record: a7c868f1-b8a6-4f0d-b361-a3d4ada30822 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:46:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KurQIzJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:46:14 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:46:14 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:46:14 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e848b-cde2-4de2-87db-22147fcfe559]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:46:14 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a505f-a874-46f5-9d87-105e1c3ca1f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc] added
Aug 02 23:46:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e83f43-90f9-4199-a787-9ae111754738]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdfb0c7-4a74-4401-a867-e26e24859e13]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KurQIzJX {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KurQIzJX" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[030c1deb-4cad-412c-8ef6-d59c35fc3cf4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KurQIzJX'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73b899-bdb3-43ff-acb6-7e469e5b3a4b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1defdd6-11e0-4dbd-bb51-406dc0e9583c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:14 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:14 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3275b4ec-8bc9-47d4-af2a-e73d9ee57357]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260]
Aug 02 23:46:14 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260] successful.
Aug 02 23:46:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a6a82-2dd7-4486-b1b1-bd589bbf13c9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbef530-cc01-43dd-a175-019b395f2fa6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:14 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:14 user nova-compute[72520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc (non-flash)
Aug 02 23:46:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:14 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:14 user nova-compute[72520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc (non-flash)
Aug 02 23:46:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd14cd0-de72-4b65-b344-d775ab42678d]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:46:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KurQIzJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:46:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:46:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23564343032663339', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:46:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564343032663339', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:46:15 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'flavor' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:46:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:46:15 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:46:15 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:46:15 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 02 23:46:15 user nova-compute[72520]:   <serial>e7a0b615-777d-4c79-851b-c77f893aa7fc</serial>
Aug 02 23:46:15 user nova-compute[72520]: </disk>
Aug 02 23:46:15 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:46:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:46:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:46:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:46:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] No VIF found with MAC fa:16:3e:e0:e5:28, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:46:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ca5b8051-0988-408f-8427-aec9c9881d6f tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.865s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:46:17 user nova-compute[72520]: INFO nova.compute.manager [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Detaching volume e7a0b615-777d-4c79-851b-c77f893aa7fc
Aug 02 23:46:17 user nova-compute[72520]: INFO nova.virt.block_device [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Attempting to driver detach volume e7a0b615-777d-4c79-851b-c77f893aa7fc from mountpoint /dev/vdc
Aug 02 23:46:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Attempting to detach device vdc from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:46:17 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:46:17 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:46:17 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 02 23:46:17 user nova-compute[72520]:   <serial>e7a0b615-777d-4c79-851b-c77f893aa7fc</serial>
Aug 02 23:46:17 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 02 23:46:17 user nova-compute[72520]: </disk>
Aug 02 23:46:17 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:46:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Successfully detached device vdc from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the persistent domain config.
Aug 02 23:46:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:46:17 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:46:17 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:46:17 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 02 23:46:17 user nova-compute[72520]:   <serial>e7a0b615-777d-4c79-851b-c77f893aa7fc</serial>
Aug 02 23:46:17 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 02 23:46:17 user nova-compute[72520]: </disk>
Aug 02 23:46:17 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691019977.89296, b9e778a7-58f6-4d25-bfbe-90777bd14b89 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:46:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Successfully detached device vdc from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the live domain config.
Aug 02 23:46:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KurQIzJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:46:17 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[010fcdb1-3652-4413-bb0b-95457a77a2a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f431ac-6f02-47f7-b5de-dd329f2d0565]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:17 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:17 user nova-compute[72520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc (non-flash)
Aug 02 23:46:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:46:17 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:46:17 user nova-compute[72520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc (non-flash)
Aug 02 23:46:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce460d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:46:17 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef310604-e1bb-4b47-8a17-b0912c22bc81]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78881672-43d0-48c9-9e9e-0293908586a8]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d193d470-75d0-4143-be85-83c1b8429f0c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d0807-35d3-4435-b9b2-c2a16e189d07]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[349750a7-3432-4f42-bec7-d48ef1caec87]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0abdd1a-1b73-4358-b0bf-c08b6aa918bd]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260]
Aug 02 23:46:18 user nova-compute[72520]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc, portal: 172.16.0.220,3260] successful.
Aug 02 23:46:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7a0b615-777d-4c79-851b-c77f893aa7fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f1136b-1452-440f-a0ed-6f41bdfab134]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] <== disconnect_volume: return (309ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'flavor' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:46:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-763d7776-b3a8-4246-9789-223e681639db tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.602s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:46:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:46:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:46:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:46:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:46:51 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:46:52 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating instance_info_cache with network_info: [{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:46:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:46:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:46:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:53 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing instance network info cache due to event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] Acquiring lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] Acquired lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:46:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG nova.network.neutron [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updated VIF entry in instance network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG nova.network.neutron [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-da114f5c-26f6-41b2-b028-6a0f1af9eb8f req-9dc407b3-ec88-42f8-a759-4d646d7c854e service nova] Releasing lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG nova.objects.instance [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'flavor' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:46:56 user nova-compute[72520]: INFO nova.compute.manager [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Attaching volume 53c30d2f-3941-432d-b3f6-27c6f63ef7d8 to /dev/vdb
Aug 02 23:46:56 user nova-compute[72520]: DEBUG os_brick.utils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c7b020-d549-441a-9945-0b230ef3a1d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd6fb5b-80e4-4b6d-8e62-9a82a5967e9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a54861-57df-45d0-bbb0-57dba5d76058]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42854a8-3896-4a17-8075-b4040f657aa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:46:56 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebf6b9f-0408-4f67-91c6-024e1ea9f25b]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG os_brick.utils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating existing volume attachment record: e432ccab-c5e6-4c71-a426-bb6241fa495e {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:46:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:46:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8001MB free_disk=25.389690399169922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:46:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:46:59 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:46:59 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:46:59 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:46:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:46:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:46:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 02 23:46:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 02 23:47:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:47:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:47:02 user nova-compute[72520]: INFO nova.compute.manager [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] instance snapshotting
Aug 02 23:47:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Beginning live snapshot process
Aug 02 23:47:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json -f qcow2" returned: 0 in 0.159s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.173s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy74zfh5k/1e3c89184f21405082d642dde70a78b0.delta 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy74zfh5k/1e3c89184f21405082d642dde70a78b0.delta 1073741824" returned: 0 in 0.058s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 02 23:47:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:47:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:47:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 02 23:47:04 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:47:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy74zfh5k/1e3c89184f21405082d642dde70a78b0.delta /opt/stack/data/nova/instances/snapshots/tmpy74zfh5k/1e3c89184f21405082d642dde70a78b0 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:47:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCFfmLMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:47:04 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:47:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:47:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:47:04 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:47:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:47:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:47:05 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df8987b-9841-48e8-8cda-0f824dc744d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:47:05 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[496a1e62-ec18-472b-9849-0d19316a86ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8] added
Aug 02 23:47:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[af79ee4e-0647-485e-9132-eeb4fcaeead3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.277s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ea689-1515-4598-8bde-1f23adb83023]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCFfmLMb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCFfmLMb" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d0d673-56cb-4fa6-bd9d-b6156a722e4c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iCFfmLMb'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4555ae6b-2c91-4f68-8320-6ab8058b3380]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.099s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7abc11-0593-48b3-aef8-b2db9860bf3c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:05 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:47:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:05 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:47:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6494ed-ec8e-4e69-807b-2d8aa751b47a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260]
Aug 02 23:47:05 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260] successful.
Aug 02 23:47:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.094s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b780881-c760-4d8c-9ef0-7ff6eeb9a37d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[464b327a-65a7-47d1-be12-a63197bdee46]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:05 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:47:05 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:05 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:47:05 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.757s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy74zfh5k/1e3c89184f21405082d642dde70a78b0.delta /opt/stack/data/nova/instances/snapshots/tmpy74zfh5k/1e3c89184f21405082d642dde70a78b0" returned: 0 in 0.917s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Snapshot extracted, beginning image upload
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689df26-54ad-40ad-9978-6987b2692ffb]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:47:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCFfmLMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:47:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.790s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:47:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] <== connect_volume: return (1793ms) {'type': 'block', 'scsi_wwn': '26162306638656162', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:47:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162306638656162', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:47:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'flavor' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:47:06 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:47:06 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:47:06 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:47:06 user nova-compute[72520]:   <serial>53c30d2f-3941-432d-b3f6-27c6f63ef7d8</serial>
Aug 02 23:47:06 user nova-compute[72520]: </disk>
Aug 02 23:47:06 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:47:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:47:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:47:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No VIF found with MAC fa:16:3e:42:5f:c4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:47:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-914fdadf-6725-41ba-9a55-80efc7370a5b tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.287s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:08 user nova-compute[72520]: INFO nova.compute.manager [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Detaching volume b39ba453-7646-473f-9920-48c880e9805e
Aug 02 23:47:08 user nova-compute[72520]: INFO nova.virt.block_device [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Attempting to driver detach volume b39ba453-7646-473f-9920-48c880e9805e from mountpoint /dev/vdb
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Attempting to detach device vdb from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:47:08 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:47:08 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:47:08 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:47:08 user nova-compute[72520]:   <serial>b39ba453-7646-473f-9920-48c880e9805e</serial>
Aug 02 23:47:08 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:47:08 user nova-compute[72520]: </disk>
Aug 02 23:47:08 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:47:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Successfully detached device vdb from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the persistent domain config.
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:47:08 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:47:08 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:47:08 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:47:08 user nova-compute[72520]:   <serial>b39ba453-7646-473f-9920-48c880e9805e</serial>
Aug 02 23:47:08 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:47:08 user nova-compute[72520]: </disk>
Aug 02 23:47:08 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020028.7536304, b9e778a7-58f6-4d25-bfbe-90777bd14b89 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:47:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Successfully detached device vdb from instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 from the live domain config.
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdETAWIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:47:08 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d46e28-f1ff-475e-9609-46b233d140b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Snapshot image upload complete
Aug 02 23:47:08 user nova-compute[72520]: INFO nova.compute.manager [None req-755cd155-fcde-4c87-b693-af0a5c24e602 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Took 6.20 seconds to snapshot the instance on the hypervisor.
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b6ef7-364d-45d2-8b44-8f200d083244]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:08 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:47:08 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:08 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:08 user nova-compute[72520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e (non-flash)
Aug 02 23:47:08 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:08 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce45c8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d5078e-c6ee-4900-b8c0-d728c66c24c5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[24188973-d15e-48fc-842d-adf519e2fe83]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:08 user nova-compute[72520]: INFO nova.compute.manager [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Rescuing
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG nova.network.neutron [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db2938-a02b-4982-b28f-cf5d1c1cdd9d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:47:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1b1d82-c236-4910-8068-4a852b23b7dc]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[933431ff-f943-4db2-86c2-a546331d89b1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fc1de-425a-4aa1-a725-0c131810c1b1]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260]
Aug 02 23:47:09 user nova-compute[72520]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e, portal: 172.16.0.220,3260] successful.
Aug 02 23:47:09 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b39ba453-7646-473f-9920-48c880e9805e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d499159e-694d-49a4-959b-5c43f4d25f7b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] <== disconnect_volume: return (387ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:09 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'flavor' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b0b9298-5b2f-4ecd-adb7-052a08664de6 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.904s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-6c9829e6-f5a6-4053-afaa-fa3f17cb9e5d req-710300ee-03a7-4a23-b82c-94c07915073e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6c9829e6-f5a6-4053-afaa-fa3f17cb9e5d req-710300ee-03a7-4a23-b82c-94c07915073e service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6c9829e6-f5a6-4053-afaa-fa3f17cb9e5d req-710300ee-03a7-4a23-b82c-94c07915073e service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6c9829e6-f5a6-4053-afaa-fa3f17cb9e5d req-710300ee-03a7-4a23-b82c-94c07915073e service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-6c9829e6-f5a6-4053-afaa-fa3f17cb9e5d req-710300ee-03a7-4a23-b82c-94c07915073e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:47:10 user nova-compute[72520]: WARNING nova.compute.manager [req-6c9829e6-f5a6-4053-afaa-fa3f17cb9e5d req-710300ee-03a7-4a23-b82c-94c07915073e service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state active and task_state rescuing.
Aug 02 23:47:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance destroyed successfully.
Aug 02 23:47:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Attempting rescue
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 02 23:47:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Creating image(s)
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'trusted_certs' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue" returned: 0 in 0.049s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'migration_context' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Start _get_guest_xml network_info=[{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:42:5f:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'resources' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'numa_topology' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:47:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'vcpu_model' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405470045',display_name='tempest-ServerRescueNegativeTestJSON-server-405470045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405470045',id=26,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPmJC3+jJREMbo4vqNbPCJGeywe1JSNQOWoUCi6p5IcE2cNco4Oup4a9sV89yRuXDMgmdqQUXimUmNv/DaDPrAMItkd3457w7kS79ih+4k6SjV+YEljCzGCexL9EtAIhw==',key_name='tempest-keypair-420863145',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-elxyxg0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d02269696a0d47738d8daa53d44b3b70',uuid=e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:42:5f:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "vif_mac": "fa:16:3e:42:5f:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'pci_devices' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:47:10 user nova-compute[72520]:   <uuid>e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8</uuid>
Aug 02 23:47:10 user nova-compute[72520]:   <name>instance-0000001a</name>
Aug 02 23:47:10 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:47:10 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:47:10 user nova-compute[72520]:   <metadata>
Aug 02 23:47:10 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:47:10 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:47:10 user nova-compute[72520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-405470045</nova:name>
Aug 02 23:47:10 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:47:10</nova:creationTime>
Aug 02 23:47:10 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:47:10 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:47:10 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:47:10 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:47:10 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:47:10 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:47:10 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:47:10 user nova-compute[72520]:       <nova:owner>
Aug 02 23:47:10 user nova-compute[72520]:         <nova:user uuid="d02269696a0d47738d8daa53d44b3b70">tempest-ServerRescueNegativeTestJSON-1442912244-project-member</nova:user>
Aug 02 23:47:10 user nova-compute[72520]:         <nova:project uuid="cb887059a9634cce9f17319a980a18f4">tempest-ServerRescueNegativeTestJSON-1442912244</nova:project>
Aug 02 23:47:10 user nova-compute[72520]:       </nova:owner>
Aug 02 23:47:10 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:47:10 user nova-compute[72520]:       <nova:ports>
Aug 02 23:47:10 user nova-compute[72520]:         <nova:port uuid="005e5e35-c836-4c41-99c6-e3233614ed8a">
Aug 02 23:47:10 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 02 23:47:10 user nova-compute[72520]:         </nova:port>
Aug 02 23:47:10 user nova-compute[72520]:       </nova:ports>
Aug 02 23:47:10 user nova-compute[72520]:     </nova:instance>
Aug 02 23:47:10 user nova-compute[72520]:   </metadata>
Aug 02 23:47:10 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:47:10 user nova-compute[72520]:     <system>
Aug 02 23:47:10 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:47:10 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:47:10 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:47:10 user nova-compute[72520]:       <entry name="serial">e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8</entry>
Aug 02 23:47:10 user nova-compute[72520]:       <entry name="uuid">e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8</entry>
Aug 02 23:47:10 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:47:10 user nova-compute[72520]:     </system>
Aug 02 23:47:10 user nova-compute[72520]:   </sysinfo>
Aug 02 23:47:10 user nova-compute[72520]:   <os>
Aug 02 23:47:10 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:47:10 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:47:10 user nova-compute[72520]:   </os>
Aug 02 23:47:10 user nova-compute[72520]:   <features>
Aug 02 23:47:10 user nova-compute[72520]:     <acpi/>
Aug 02 23:47:10 user nova-compute[72520]:     <apic/>
Aug 02 23:47:10 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:47:10 user nova-compute[72520]:   </features>
Aug 02 23:47:10 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:47:10 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:47:10 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:47:10 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:47:10 user nova-compute[72520]:   </clock>
Aug 02 23:47:10 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:47:10 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:47:10 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:47:10 user nova-compute[72520]:   </cpu>
Aug 02 23:47:10 user nova-compute[72520]:   <devices>
Aug 02 23:47:10 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:47:10 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:47:10 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue"/>
Aug 02 23:47:10 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:47:10 user nova-compute[72520]:     </disk>
Aug 02 23:47:10 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:47:10 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:47:10 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk"/>
Aug 02 23:47:10 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:47:10 user nova-compute[72520]:     </disk>
Aug 02 23:47:10 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:47:10 user nova-compute[72520]:       <mac address="fa:16:3e:42:5f:c4"/>
Aug 02 23:47:10 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:47:10 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:47:10 user nova-compute[72520]:       <target dev="tap005e5e35-c8"/>
Aug 02 23:47:10 user nova-compute[72520]:     </interface>
Aug 02 23:47:10 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:47:10 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/console.log" append="off"/>
Aug 02 23:47:10 user nova-compute[72520]:     </serial>
Aug 02 23:47:10 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:47:10 user nova-compute[72520]:     <video>
Aug 02 23:47:10 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:47:10 user nova-compute[72520]:     </video>
Aug 02 23:47:10 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:47:10 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:47:10 user nova-compute[72520]:     </rng>
Aug 02 23:47:10 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:47:10 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:47:10 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:47:10 user nova-compute[72520]:     </memballoon>
Aug 02 23:47:10 user nova-compute[72520]:   </devices>
Aug 02 23:47:10 user nova-compute[72520]: </domain>
Aug 02 23:47:10 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:47:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance destroyed successfully.
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:47:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] No VIF found with MAC fa:16:3e:42:5f:c4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:47:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-e82ddc38-5254-4deb-aaa3-1f0e5abe71a6 req-b32e5267-377f-44ec-9b7a-7cca62dfc300 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e82ddc38-5254-4deb-aaa3-1f0e5abe71a6 req-b32e5267-377f-44ec-9b7a-7cca62dfc300 service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e82ddc38-5254-4deb-aaa3-1f0e5abe71a6 req-b32e5267-377f-44ec-9b7a-7cca62dfc300 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e82ddc38-5254-4deb-aaa3-1f0e5abe71a6 req-b32e5267-377f-44ec-9b7a-7cca62dfc300 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-e82ddc38-5254-4deb-aaa3-1f0e5abe71a6 req-b32e5267-377f-44ec-9b7a-7cca62dfc300 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:47:12 user nova-compute[72520]: WARNING nova.compute.manager [req-e82ddc38-5254-4deb-aaa3-1f0e5abe71a6 req-b32e5267-377f-44ec-9b7a-7cca62dfc300 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state active and task_state rescuing.
Aug 02 23:47:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:47:14 user nova-compute[72520]: WARNING nova.compute.manager [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state active and task_state rescuing.
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:47:14 user nova-compute[72520]: WARNING nova.compute.manager [req-8f5ae80d-a850-4915-964d-dbe616726ce7 req-a0b045cb-4108-4a37-98fb-316921a7b55b service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state active and task_state rescuing.
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020034.379254, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:47:14 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] VM Resumed (Lifecycle Event)
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-372e2b0f-682e-4de7-a7d2-9ff922d322e8 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:47:14 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020034.3805282, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:47:14 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] VM Started (Lifecycle Event)
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:47:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:47:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:47:23 user nova-compute[72520]: INFO nova.compute.claims [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Claim successful on node user
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:47:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.policy [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4848df27d404a9eb33ec7e7dd45dd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f50f35e2b7466ea2a922b0525b2fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:47:23 user nova-compute[72520]: INFO nova.virt.block_device [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Booting with volume 91d325d2-c6a9-4a72-a5e9-a45c3d645fca at /dev/vda
Aug 02 23:47:23 user nova-compute[72520]: DEBUG os_brick.utils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f23af3-a692-4263-896b-5494e454b20e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8c90c-9179-4d1c-ba1a-c8219afe9d68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[198f8ffe-54fb-44cb-b49c-cf1c2e6bfe2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1865eae6-d5c9-4584-a250-348f1c16ab6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:47:23 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:47:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5786aa6d-53ca-4b38-aad1-2917bdbb5824]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG os_brick.utils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:47:23 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating existing volume attachment record: 4cb6be98-e50e-4302-9956-707db3b3a065 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:47:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Successfully created port: 06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Successfully updated port: 06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquired lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-changed-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Refreshing instance network info cache due to event network-changed-06065754-8489-41bd-acb5-f264f5633570. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] Acquiring lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:47:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Releasing lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance network_info: |[{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] Acquired lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Refreshing network info cache for port 06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updated VIF entry in instance network info cache for port 06065754-8489-41bd-acb5-f264f5633570. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7c945ff1-26b8-43b0-9436-f73ac3bac8a6 req-42e968bb-3a09-4e20-ae1d-c80bee543c9d service nova] Releasing lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:26 user nova-compute[72520]: WARNING nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 0e13bfd1-68d9-442a-b95b-40caaa10586c {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "23931909-81f4-44fb-b936-10a27c16febb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "23931909-81f4-44fb-b936-10a27c16febb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:47:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Creating image(s)
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Ensure instance console log exists: /opt/stack/data/nova/instances/982bd91f-8b1a-41b2-ad23-3d31136de392/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Start _get_guest_xml network_info=[{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '982bd91f-8b1a-41b2-ad23-3d31136de392', 'attached_at': '', 'detached_at': '', 'volume_id': '91d325d2-c6a9-4a72-a5e9-a45c3d645fca', 'serial': '91d325d2-c6a9-4a72-a5e9-a45c3d645fca'}, 'attachment_id': '4cb6be98-e50e-4302-9956-707db3b3a065', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:47:31 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:47:31 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:47:31 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:47:31 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:47:31 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb5a01-0db8-4970-b68c-4bfa1a2552e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:47:31 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc87ef5e-1b6a-4154-9510-2e40ddda1829]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca] added
Aug 02 23:47:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c40706-7d59-4400-ace9-a17f53d40b59]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e3f35-e4ac-4b7f-b1fc-ace4383b95c2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtCpHbcJ {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtCpHbcJ" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc201f2-a39f-4778-a4b5-1d39948c6c20]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jtCpHbcJ'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a8dd97-e75b-4276-921a-ca1d87c10cea]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff079615-4195-4190-8bd1-ca2615e896c5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bde6c4-36fa-4ad3-aeb0-faf23948ec1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]
Aug 02 23:47:31 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.
Aug 02 23:47:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[063b169c-d040-4954-86c4-d0f92c274c6d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a450e-2ce4-4537-ace6-137465de8d5f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:47:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:47:31 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:47:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:47:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e44544-5255-49a9-ac61-3949bc0915c8]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:47:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23131353963303163', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131353963303163', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1912665491',display_name='tempest-ServerActionsTestOtherA-server-1912665491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1912665491',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-oyl88jgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=982bd91f-8b1a-41b2-ad23-3d31136de392,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'pci_devices' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:47:33 user nova-compute[72520]:   <uuid>982bd91f-8b1a-41b2-ad23-3d31136de392</uuid>
Aug 02 23:47:33 user nova-compute[72520]:   <name>instance-0000001c</name>
Aug 02 23:47:33 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:47:33 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:47:33 user nova-compute[72520]:   <metadata>
Aug 02 23:47:33 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:47:33 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:47:33 user nova-compute[72520]:       <nova:name>tempest-ServerActionsTestOtherA-server-1912665491</nova:name>
Aug 02 23:47:33 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:47:31</nova:creationTime>
Aug 02 23:47:33 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:47:33 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:47:33 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:47:33 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:47:33 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:47:33 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:47:33 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:47:33 user nova-compute[72520]:       <nova:owner>
Aug 02 23:47:33 user nova-compute[72520]:         <nova:user uuid="e4848df27d404a9eb33ec7e7dd45dd12">tempest-ServerActionsTestOtherA-102203488-project-member</nova:user>
Aug 02 23:47:33 user nova-compute[72520]:         <nova:project uuid="c2f50f35e2b7466ea2a922b0525b2fb1">tempest-ServerActionsTestOtherA-102203488</nova:project>
Aug 02 23:47:33 user nova-compute[72520]:       </nova:owner>
Aug 02 23:47:33 user nova-compute[72520]:       <nova:ports>
Aug 02 23:47:33 user nova-compute[72520]:         <nova:port uuid="06065754-8489-41bd-acb5-f264f5633570">
Aug 02 23:47:33 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 02 23:47:33 user nova-compute[72520]:         </nova:port>
Aug 02 23:47:33 user nova-compute[72520]:       </nova:ports>
Aug 02 23:47:33 user nova-compute[72520]:     </nova:instance>
Aug 02 23:47:33 user nova-compute[72520]:   </metadata>
Aug 02 23:47:33 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:47:33 user nova-compute[72520]:     <system>
Aug 02 23:47:33 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:47:33 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:47:33 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:47:33 user nova-compute[72520]:       <entry name="serial">982bd91f-8b1a-41b2-ad23-3d31136de392</entry>
Aug 02 23:47:33 user nova-compute[72520]:       <entry name="uuid">982bd91f-8b1a-41b2-ad23-3d31136de392</entry>
Aug 02 23:47:33 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:47:33 user nova-compute[72520]:     </system>
Aug 02 23:47:33 user nova-compute[72520]:   </sysinfo>
Aug 02 23:47:33 user nova-compute[72520]:   <os>
Aug 02 23:47:33 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:47:33 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:47:33 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:47:33 user nova-compute[72520]:   </os>
Aug 02 23:47:33 user nova-compute[72520]:   <features>
Aug 02 23:47:33 user nova-compute[72520]:     <acpi/>
Aug 02 23:47:33 user nova-compute[72520]:     <apic/>
Aug 02 23:47:33 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:47:33 user nova-compute[72520]:   </features>
Aug 02 23:47:33 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:47:33 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:47:33 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:47:33 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:47:33 user nova-compute[72520]:   </clock>
Aug 02 23:47:33 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:47:33 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:47:33 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:47:33 user nova-compute[72520]:   </cpu>
Aug 02 23:47:33 user nova-compute[72520]:   <devices>
Aug 02 23:47:33 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:47:33 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:47:33 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 02 23:47:33 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:47:33 user nova-compute[72520]:       <serial>91d325d2-c6a9-4a72-a5e9-a45c3d645fca</serial>
Aug 02 23:47:33 user nova-compute[72520]:     </disk>
Aug 02 23:47:33 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:47:33 user nova-compute[72520]:       <mac address="fa:16:3e:35:1c:34"/>
Aug 02 23:47:33 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:47:33 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:47:33 user nova-compute[72520]:       <target dev="tap06065754-84"/>
Aug 02 23:47:33 user nova-compute[72520]:     </interface>
Aug 02 23:47:33 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:47:33 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/982bd91f-8b1a-41b2-ad23-3d31136de392/console.log" append="off"/>
Aug 02 23:47:33 user nova-compute[72520]:     </serial>
Aug 02 23:47:33 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:47:33 user nova-compute[72520]:     <video>
Aug 02 23:47:33 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:47:33 user nova-compute[72520]:     </video>
Aug 02 23:47:33 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:47:33 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:47:33 user nova-compute[72520]:     </rng>
Aug 02 23:47:33 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:47:33 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:47:33 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:47:33 user nova-compute[72520]:     </memballoon>
Aug 02 23:47:33 user nova-compute[72520]:   </devices>
Aug 02 23:47:33 user nova-compute[72520]: </domain>
Aug 02 23:47:33 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1912665491',display_name='tempest-ServerActionsTestOtherA-server-1912665491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1912665491',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-oyl88jgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=982bd91f-8b1a-41b2-ad23-3d31136de392,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG os_vif [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06065754-84, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06065754-84, col_values=(('external_ids', {'iface-id': '06065754-8489-41bd-acb5-f264f5633570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:1c:34', 'vm-uuid': '982bd91f-8b1a-41b2-ad23-3d31136de392'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:33 user nova-compute[72520]: INFO os_vif [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84')
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No VIF found with MAC fa:16:3e:35:1c:34, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:47:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-705cf66e-1181-4bfe-8bad-139a28783f82 req-c4bc506b-ac8a-4581-a4b2-2f5e44219f71 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-705cf66e-1181-4bfe-8bad-139a28783f82 req-c4bc506b-ac8a-4581-a4b2-2f5e44219f71 service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-705cf66e-1181-4bfe-8bad-139a28783f82 req-c4bc506b-ac8a-4581-a4b2-2f5e44219f71 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-705cf66e-1181-4bfe-8bad-139a28783f82 req-c4bc506b-ac8a-4581-a4b2-2f5e44219f71 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-705cf66e-1181-4bfe-8bad-139a28783f82 req-c4bc506b-ac8a-4581-a4b2-2f5e44219f71 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:47:34 user nova-compute[72520]: WARNING nova.compute.manager [req-705cf66e-1181-4bfe-8bad-139a28783f82 req-c4bc506b-ac8a-4581-a4b2-2f5e44219f71 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received unexpected event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 for instance with vm_state building and task_state spawning.
Aug 02 23:47:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020056.804245, 982bd91f-8b1a-41b2-ad23-3d31136de392 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:47:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] VM Resumed (Lifecycle Event)
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:47:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance spawned successfully.
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:47:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020056.8093042, 982bd91f-8b1a-41b2-ad23-3d31136de392 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:47:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] VM Started (Lifecycle Event)
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:47:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:47:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 02 23:47:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:47:37 user nova-compute[72520]: DEBUG nova.compute.manager [req-126872f2-83a4-473d-bf6b-e5ac3cc53a52 req-bf503172-1ce4-4069-90d5-7fa090350fa2 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-126872f2-83a4-473d-bf6b-e5ac3cc53a52 req-bf503172-1ce4-4069-90d5-7fa090350fa2 service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-126872f2-83a4-473d-bf6b-e5ac3cc53a52 req-bf503172-1ce4-4069-90d5-7fa090350fa2 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-126872f2-83a4-473d-bf6b-e5ac3cc53a52 req-bf503172-1ce4-4069-90d5-7fa090350fa2 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:37 user nova-compute[72520]: DEBUG nova.compute.manager [req-126872f2-83a4-473d-bf6b-e5ac3cc53a52 req-bf503172-1ce4-4069-90d5-7fa090350fa2 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:47:37 user nova-compute[72520]: WARNING nova.compute.manager [req-126872f2-83a4-473d-bf6b-e5ac3cc53a52 req-bf503172-1ce4-4069-90d5-7fa090350fa2 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received unexpected event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 for instance with vm_state building and task_state spawning.
Aug 02 23:47:37 user nova-compute[72520]: INFO nova.compute.manager [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Took 14.06 seconds to build instance.
Aug 02 23:47:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0dee074-db58-43d2-9fab-1877df064434 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.208s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.224s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:37 user nova-compute[72520]: INFO nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 02 23:47:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:52 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:47:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:47:53 user nova-compute[72520]: INFO nova.compute.claims [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Claim successful on node user
Aug 02 23:47:53 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 02 23:47:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:47:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.policy [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7b27a450e444b308fc54577d724cc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b274c7dd5374d739bd700643b0bf63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:47:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Creating image(s)
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "/opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "/opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "/opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "62abcb74171a0242d2d759e35e2bb468644b5a7d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "62abcb74171a0242d2d759e35e2bb468644b5a7d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.part --force-share --output=json" returned: 0 in 0.172s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG nova.virt.images [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] 240d88aa-9816-4486-bc0b-54184b80e54e was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.part /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Successfully created port: cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.part /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.converted" returned: 0 in 0.205s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "62abcb74171a0242d2d759e35e2bb468644b5a7d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.145s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json" returned: 0 in 0.158s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "62abcb74171a0242d2d759e35e2bb468644b5a7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "62abcb74171a0242d2d759e35e2bb468644b5a7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d,backing_fmt=raw /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d,backing_fmt=raw /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk 1073741824" returned: 0 in 0.052s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "62abcb74171a0242d2d759e35e2bb468644b5a7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json" returned: 0 in 0.192s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Cannot resize image /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.objects.instance [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'migration_context' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Ensure instance console log exists: /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.network.neutron [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Successfully updated port: cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquired lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.network.neutron [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-changed-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing instance network info cache due to event network-changed-cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] Acquiring lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG nova.network.neutron [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Releasing lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance network_info: |[{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] Acquired lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing network info cache for port cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Start _get_guest_xml network_info=[{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:47:50Z,direct_url=<?>,disk_format='qcow2',id=240d88aa-9816-4486-bc0b-54184b80e54e,min_disk=0,min_ram=0,name='tempest-scenario-img--1437528983',owner='4b274c7dd5374d739bd700643b0bf63e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:47:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '240d88aa-9816-4486-bc0b-54184b80e54e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:47:57 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:47:57 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:47:50Z,direct_url=<?>,disk_format='qcow2',id=240d88aa-9816-4486-bc0b-54184b80e54e,min_disk=0,min_ram=0,name='tempest-scenario-img--1437528983',owner='4b274c7dd5374d739bd700643b0bf63e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:47:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646579882',display_name='tempest-TestMinimumBasicScenario-server-646579882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646579882',id=29,image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm+lQlr4C68vf2L3WNELyzZM6+9+z5v54RWQE//K+Rt5Dxcs7aOI+QVJsGj4ECNsYlJs3O6wqYSsQONvn5Xe0sMITk9hqdLPEnYoqMO0YQVGzu95vqn/DwHV3JOqzzajg==',key_name='tempest-TestMinimumBasicScenario-469330076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-08ty7096',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:47:54Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=06f97de2-7a1f-4fc4-92cb-27e08df31263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'pci_devices' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:47:57 user nova-compute[72520]:   <uuid>06f97de2-7a1f-4fc4-92cb-27e08df31263</uuid>
Aug 02 23:47:57 user nova-compute[72520]:   <name>instance-0000001d</name>
Aug 02 23:47:57 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:47:57 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:47:57 user nova-compute[72520]:   <metadata>
Aug 02 23:47:57 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:47:57 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:47:57 user nova-compute[72520]:       <nova:name>tempest-TestMinimumBasicScenario-server-646579882</nova:name>
Aug 02 23:47:57 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:47:57</nova:creationTime>
Aug 02 23:47:57 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:47:57 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:47:57 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:47:57 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:47:57 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:47:57 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:47:57 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:47:57 user nova-compute[72520]:       <nova:owner>
Aug 02 23:47:57 user nova-compute[72520]:         <nova:user uuid="c7b27a450e444b308fc54577d724cc7a">tempest-TestMinimumBasicScenario-951726597-project-member</nova:user>
Aug 02 23:47:57 user nova-compute[72520]:         <nova:project uuid="4b274c7dd5374d739bd700643b0bf63e">tempest-TestMinimumBasicScenario-951726597</nova:project>
Aug 02 23:47:57 user nova-compute[72520]:       </nova:owner>
Aug 02 23:47:57 user nova-compute[72520]:       <nova:root type="image" uuid="240d88aa-9816-4486-bc0b-54184b80e54e"/>
Aug 02 23:47:57 user nova-compute[72520]:       <nova:ports>
Aug 02 23:47:57 user nova-compute[72520]:         <nova:port uuid="cb421f82-bf44-46ba-98c0-83c543190284">
Aug 02 23:47:57 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:47:57 user nova-compute[72520]:         </nova:port>
Aug 02 23:47:57 user nova-compute[72520]:       </nova:ports>
Aug 02 23:47:57 user nova-compute[72520]:     </nova:instance>
Aug 02 23:47:57 user nova-compute[72520]:   </metadata>
Aug 02 23:47:57 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:47:57 user nova-compute[72520]:     <system>
Aug 02 23:47:57 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:47:57 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:47:57 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:47:57 user nova-compute[72520]:       <entry name="serial">06f97de2-7a1f-4fc4-92cb-27e08df31263</entry>
Aug 02 23:47:57 user nova-compute[72520]:       <entry name="uuid">06f97de2-7a1f-4fc4-92cb-27e08df31263</entry>
Aug 02 23:47:57 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:47:57 user nova-compute[72520]:     </system>
Aug 02 23:47:57 user nova-compute[72520]:   </sysinfo>
Aug 02 23:47:57 user nova-compute[72520]:   <os>
Aug 02 23:47:57 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:47:57 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:47:57 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:47:57 user nova-compute[72520]:   </os>
Aug 02 23:47:57 user nova-compute[72520]:   <features>
Aug 02 23:47:57 user nova-compute[72520]:     <acpi/>
Aug 02 23:47:57 user nova-compute[72520]:     <apic/>
Aug 02 23:47:57 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:47:57 user nova-compute[72520]:   </features>
Aug 02 23:47:57 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:47:57 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:47:57 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:47:57 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:47:57 user nova-compute[72520]:   </clock>
Aug 02 23:47:57 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:47:57 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:47:57 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:47:57 user nova-compute[72520]:   </cpu>
Aug 02 23:47:57 user nova-compute[72520]:   <devices>
Aug 02 23:47:57 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:47:57 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:47:57 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk"/>
Aug 02 23:47:57 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:47:57 user nova-compute[72520]:     </disk>
Aug 02 23:47:57 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:47:57 user nova-compute[72520]:       <mac address="fa:16:3e:f9:fe:42"/>
Aug 02 23:47:57 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:47:57 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:47:57 user nova-compute[72520]:       <target dev="tapcb421f82-bf"/>
Aug 02 23:47:57 user nova-compute[72520]:     </interface>
Aug 02 23:47:57 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:47:57 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/console.log" append="off"/>
Aug 02 23:47:57 user nova-compute[72520]:     </serial>
Aug 02 23:47:57 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:47:57 user nova-compute[72520]:     <video>
Aug 02 23:47:57 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:47:57 user nova-compute[72520]:     </video>
Aug 02 23:47:57 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:47:57 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:47:57 user nova-compute[72520]:     </rng>
Aug 02 23:47:57 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:47:57 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:47:57 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:47:57 user nova-compute[72520]:     </memballoon>
Aug 02 23:47:57 user nova-compute[72520]:   </devices>
Aug 02 23:47:57 user nova-compute[72520]: </domain>
Aug 02 23:47:57 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646579882',display_name='tempest-TestMinimumBasicScenario-server-646579882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646579882',id=29,image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm+lQlr4C68vf2L3WNELyzZM6+9+z5v54RWQE//K+Rt5Dxcs7aOI+QVJsGj4ECNsYlJs3O6wqYSsQONvn5Xe0sMITk9hqdLPEnYoqMO0YQVGzu95vqn/DwHV3JOqzzajg==',key_name='tempest-TestMinimumBasicScenario-469330076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-08ty7096',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:47:54Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=06f97de2-7a1f-4fc4-92cb-27e08df31263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG os_vif [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb421f82-bf, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb421f82-bf, col_values=(('external_ids', {'iface-id': 'cb421f82-bf44-46ba-98c0-83c543190284', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:fe:42', 'vm-uuid': '06f97de2-7a1f-4fc4-92cb-27e08df31263'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:47:57 user nova-compute[72520]: INFO os_vif [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf')
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No VIF found with MAC fa:16:3e:f9:fe:42, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updated VIF entry in instance network info cache for port cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2fb815f4-8fa8-4b40-9349-c44c9383ef81 req-85a6e3b4-ba25-42a2-aced-7a6e0be72786 service nova] Releasing lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:58 user nova-compute[72520]: INFO nova.compute.manager [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Terminating instance
Aug 02 23:47:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:47:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-cd6af4d4-73c3-45b1-8c11-7220e4b5d5ca req-af20eeae-a550-4107-b47d-4f37f558a6f4 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cd6af4d4-73c3-45b1-8c11-7220e4b5d5ca req-af20eeae-a550-4107-b47d-4f37f558a6f4 service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cd6af4d4-73c3-45b1-8c11-7220e4b5d5ca req-af20eeae-a550-4107-b47d-4f37f558a6f4 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cd6af4d4-73c3-45b1-8c11-7220e4b5d5ca req-af20eeae-a550-4107-b47d-4f37f558a6f4 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-cd6af4d4-73c3-45b1-8c11-7220e4b5d5ca req-af20eeae-a550-4107-b47d-4f37f558a6f4 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:47:59 user nova-compute[72520]: WARNING nova.compute.manager [req-cd6af4d4-73c3-45b1-8c11-7220e4b5d5ca req-af20eeae-a550-4107-b47d-4f37f558a6f4 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received unexpected event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with vm_state building and task_state spawning.
Aug 02 23:47:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:47:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:00 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:48:00 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=25.265422821044922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Instance destroyed successfully.
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lazy-loading 'resources' on Instance uuid b9e778a7-58f6-4d25-bfbe-90777bd14b89 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1709175793',display_name='tempest-TestServerVolumeAttachmentScenario-server-1709175793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1709175793',id=25,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/gYIGVxNrPEpP3rshv7DkgQgNcAdIc6YU1V1Sj9zpDGXo1hGb5OA44tI4In8Jh4G9jc5hSaAY1nOfV35KtdeJBOBGCcMAClnvZ37Up1pXYkXD1gNha4RJpVwlYpKdFgQ==',key_name='tempest-keypair-54782840',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:44:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097d7a8bab8c4be1810caead9bcd694e',ramdisk_id='',reservation_id='r-oi0f0suh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1176961382',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1176961382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:44:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46d8df04adff403a8de2a6d65105ea54',uuid=b9e778a7-58f6-4d25-bfbe-90777bd14b89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Converting VIF {"id": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "address": "fa:16:3e:e0:e5:28", "network": {"id": "308141b1-8f6c-4c6d-ab2d-440289fda6e0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-992613340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097d7a8bab8c4be1810caead9bcd694e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca7da38-cf", "ovs_interfaceid": "fca7da38-cf03-4628-862b-ae1e22fcb32a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e5:28,bridge_name='br-int',has_traffic_filtering=True,id=fca7da38-cf03-4628-862b-ae1e22fcb32a,network=Network(308141b1-8f6c-4c6d-ab2d-440289fda6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca7da38-cf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG os_vif [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e5:28,bridge_name='br-int',has_traffic_filtering=True,id=fca7da38-cf03-4628-862b-ae1e22fcb32a,network=Network(308141b1-8f6c-4c6d-ab2d-440289fda6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca7da38-cf') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfca7da38-cf, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:48:00 user nova-compute[72520]: INFO os_vif [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e5:28,bridge_name='br-int',has_traffic_filtering=True,id=fca7da38-cf03-4628-862b-ae1e22fcb32a,network=Network(308141b1-8f6c-4c6d-ab2d-440289fda6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca7da38-cf')
Aug 02 23:48:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Deleting instance files /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89_del
Aug 02 23:48:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Deletion of /opt/stack/data/nova/instances/b9e778a7-58f6-4d25-bfbe-90777bd14b89_del complete
Aug 02 23:48:00 user nova-compute[72520]: INFO nova.compute.manager [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 02 23:48:00 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b9e778a7-58f6-4d25-bfbe-90777bd14b89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 982bd91f-8b1a-41b2-ad23-3d31136de392 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:00 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020080.9984782, 06f97de2-7a1f-4fc4-92cb-27e08df31263 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:48:00 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] VM Resumed (Lifecycle Event)
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance spawned successfully.
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020081.001702, 06f97de2-7a1f-4fc4-92cb-27e08df31263 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] VM Started (Lifecycle Event)
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:48:01 user nova-compute[72520]: WARNING nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received unexpected event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with vm_state building and task_state spawning.
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-vif-unplugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] No waiting events found dispatching network-vif-unplugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-vif-unplugged-fca7da38-cf03-4628-862b-ae1e22fcb32a for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Acquiring lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] No waiting events found dispatching network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:48:01 user nova-compute[72520]: WARNING nova.compute.manager [req-c833decd-fe66-4fb4-b432-d14054cfcbcd req-d1790e95-1015-4028-a6b5-22dff004c558 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received unexpected event network-vif-plugged-fca7da38-cf03-4628-862b-ae1e22fcb32a for instance with vm_state active and task_state deleting.
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Took 6.77 seconds to spawn the instance on the hypervisor.
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.compute.manager [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Took 7.71 seconds to build instance.
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-23bd3c3d-f8fb-4c22-a2ea-c202dbef8b01 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.807s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Took 1.15 seconds to deallocate network for instance.
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:01 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Deleted allocations for instance b9e778a7-58f6-4d25-bfbe-90777bd14b89
Aug 02 23:48:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-50343925-a914-43b8-b763-391b26b8a9f1 tempest-TestServerVolumeAttachmentScenario-1176961382 tempest-TestServerVolumeAttachmentScenario-1176961382-project-member] Lock "b9e778a7-58f6-4d25-bfbe-90777bd14b89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.997s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-d4a54b9f-8d27-4a59-ae3f-70b42f0a6270 req-fcdd298a-778b-4b77-8de4-4a657762ed27 service nova] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Received event network-vif-deleted-fca7da38-cf03-4628-862b-ae1e22fcb32a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:48:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:48:11 user nova-compute[72520]: INFO nova.compute.claims [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Claim successful on node user
Aug 02 23:48:12 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:48:12 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:48:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:48:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:48:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:48:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:48:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:48:12 user nova-compute[72520]: INFO nova.virt.block_device [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Booting with volume-backed-image bf7ff550-99bb-492f-8b9b-e7b427d12188 at /dev/vda
Aug 02 23:48:12 user nova-compute[72520]: DEBUG nova.policy [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3ecb56ac3554ee3b1ef658d9cdd3869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542e5ab2d59245f58d357cf688e30a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:48:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Successfully created port: 51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:48:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Successfully updated port: 51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-changed-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Refreshing instance network info cache due to event network-changed-51365aea-040d-4f66-bf48-ae79c5371e1b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] Acquiring lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:48:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updating instance_info_cache with network_info: [{"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020079.7211766, b9e778a7-58f6-4d25-bfbe-90777bd14b89 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:48:15 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] VM Stopped (Lifecycle Event)
Aug 02 23:48:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance network_info: |[{"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] Acquired lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG nova.network.neutron [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Refreshing network info cache for port 51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-820961f2-06d0-4abc-b6ca-90001176daa2 None None] [instance: b9e778a7-58f6-4d25-bfbe-90777bd14b89] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG nova.network.neutron [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updated VIF entry in instance network info cache for port 51365aea-040d-4f66-bf48-ae79c5371e1b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG nova.network.neutron [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updating instance_info_cache with network_info: [{"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:48:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1f6d8cfe-bf91-42f4-895c-1b628a35f8b0 req-3c9135e0-5da9-440c-832b-04f763059621 service nova] Releasing lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:48:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG os_brick.utils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa668ff-adc8-4fe7-b51a-f5601f44efe9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3228cd-edcb-4531-aadd-487272ceb995]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb42ba-9edf-4956-9b2a-6e44771b26de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6ab73-3c98-43c2-b5f5-27c325170a5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:48:23 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:48:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bbde8d-60b0-4ef3-85d2-ada0a72ac984]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG os_brick.utils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updating existing volume attachment record: 05656e28-e743-42f1-a719-cbdcac879882 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:48:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:48:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Creating image(s)
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Start _get_guest_xml network_info=[{"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgcVhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1103e2e-7595-4cb7-89ff-dda2fa121ad9', 'attached_at': '', 'detached_at': '', 'volume_id': '39e22842-5ac4-43df-bb63-d31dba32bf7d', 'serial': '39e22842-5ac4-43df-bb63-d31dba32bf7d'}, 'attachment_id': '05656e28-e743-42f1-a719-cbdcac879882', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:48:31 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:48:31 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgcVhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:48:31 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:48:31 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:48:31 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c794a0-8ca3-41c4-bada-41c8dde338e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:48:31 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcc2b01-2e90-4cd6-84e5-83a851773b76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d] added
Aug 02 23:48:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a6b67b-4548-4fb2-95ee-0460716ddfe2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[156db001-d7a4-4ac2-849f-b2966e76e4c4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMgcVhOn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMgcVhOn" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde472f0-6b01-47b0-9628-4cba9911c9cd]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMgcVhOn'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da99bf77-db91-476c-8837-f4d13d475d38]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c1ba7a-8775-4d66-a5b5-224fedc120e3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:48:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:48:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd8e4f5-41c2-4b6d-9f58-99968642fad7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260]
Aug 02 23:48:31 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260] successful.
Aug 02 23:48:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0683322-39cc-414f-a207-f03429428de6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034eabd-5a53-41f1-8db1-1a891cbcd10e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:48:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:48:31 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:48:31 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f80a2-e8f2-479e-8b1d-63a57a1904e2]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:48:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgcVhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23466623333356134', 'path': '/dev/sde'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466623333356134', 'path': '/dev/sde'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1534305402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1534305402',id=30,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-7pn4563d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:48:13Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=a1103e2e-7595-4cb7-89ff-dda2fa121ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'pci_devices' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:48:32 user nova-compute[72520]:   <uuid>a1103e2e-7595-4cb7-89ff-dda2fa121ad9</uuid>
Aug 02 23:48:32 user nova-compute[72520]:   <name>instance-0000001e</name>
Aug 02 23:48:32 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:48:32 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:48:32 user nova-compute[72520]:   <metadata>
Aug 02 23:48:32 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:48:32 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:48:32 user nova-compute[72520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1534305402</nova:name>
Aug 02 23:48:32 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:48:31</nova:creationTime>
Aug 02 23:48:32 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:48:32 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:48:32 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:48:32 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:48:32 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:48:32 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:48:32 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:48:32 user nova-compute[72520]:       <nova:owner>
Aug 02 23:48:32 user nova-compute[72520]:         <nova:user uuid="f3ecb56ac3554ee3b1ef658d9cdd3869">tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member</nova:user>
Aug 02 23:48:32 user nova-compute[72520]:         <nova:project uuid="542e5ab2d59245f58d357cf688e30a43">tempest-ServerBootFromVolumeStableRescueTest-1108272558</nova:project>
Aug 02 23:48:32 user nova-compute[72520]:       </nova:owner>
Aug 02 23:48:32 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:48:32 user nova-compute[72520]:       <nova:ports>
Aug 02 23:48:32 user nova-compute[72520]:         <nova:port uuid="51365aea-040d-4f66-bf48-ae79c5371e1b">
Aug 02 23:48:32 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 02 23:48:32 user nova-compute[72520]:         </nova:port>
Aug 02 23:48:32 user nova-compute[72520]:       </nova:ports>
Aug 02 23:48:32 user nova-compute[72520]:     </nova:instance>
Aug 02 23:48:32 user nova-compute[72520]:   </metadata>
Aug 02 23:48:32 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:48:32 user nova-compute[72520]:     <system>
Aug 02 23:48:32 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:48:32 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:48:32 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:48:32 user nova-compute[72520]:       <entry name="serial">a1103e2e-7595-4cb7-89ff-dda2fa121ad9</entry>
Aug 02 23:48:32 user nova-compute[72520]:       <entry name="uuid">a1103e2e-7595-4cb7-89ff-dda2fa121ad9</entry>
Aug 02 23:48:32 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:48:32 user nova-compute[72520]:     </system>
Aug 02 23:48:32 user nova-compute[72520]:   </sysinfo>
Aug 02 23:48:32 user nova-compute[72520]:   <os>
Aug 02 23:48:32 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:48:32 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:48:32 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:48:32 user nova-compute[72520]:   </os>
Aug 02 23:48:32 user nova-compute[72520]:   <features>
Aug 02 23:48:32 user nova-compute[72520]:     <acpi/>
Aug 02 23:48:32 user nova-compute[72520]:     <apic/>
Aug 02 23:48:32 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:48:32 user nova-compute[72520]:   </features>
Aug 02 23:48:32 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:48:32 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:48:32 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:48:32 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:48:32 user nova-compute[72520]:   </clock>
Aug 02 23:48:32 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:48:32 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:48:32 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:48:32 user nova-compute[72520]:   </cpu>
Aug 02 23:48:32 user nova-compute[72520]:   <devices>
Aug 02 23:48:32 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:48:32 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:48:32 user nova-compute[72520]:       <source dev="/dev/sde"/>
Aug 02 23:48:32 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:48:32 user nova-compute[72520]:       <serial>39e22842-5ac4-43df-bb63-d31dba32bf7d</serial>
Aug 02 23:48:32 user nova-compute[72520]:     </disk>
Aug 02 23:48:32 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:48:32 user nova-compute[72520]:       <mac address="fa:16:3e:f1:5f:6f"/>
Aug 02 23:48:32 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:48:32 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:48:32 user nova-compute[72520]:       <target dev="tap51365aea-04"/>
Aug 02 23:48:32 user nova-compute[72520]:     </interface>
Aug 02 23:48:32 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:48:32 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/console.log" append="off"/>
Aug 02 23:48:32 user nova-compute[72520]:     </serial>
Aug 02 23:48:32 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:48:32 user nova-compute[72520]:     <video>
Aug 02 23:48:32 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:48:32 user nova-compute[72520]:     </video>
Aug 02 23:48:32 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:48:32 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:48:32 user nova-compute[72520]:     </rng>
Aug 02 23:48:32 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:48:32 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:48:32 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:48:32 user nova-compute[72520]:     </memballoon>
Aug 02 23:48:32 user nova-compute[72520]:   </devices>
Aug 02 23:48:32 user nova-compute[72520]: </domain>
Aug 02 23:48:32 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1534305402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1534305402',id=30,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-7pn4563d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:48:13Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=a1103e2e-7595-4cb7-89ff-dda2fa121ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG os_vif [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51365aea-04, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51365aea-04, col_values=(('external_ids', {'iface-id': '51365aea-040d-4f66-bf48-ae79c5371e1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:5f:6f', 'vm-uuid': 'a1103e2e-7595-4cb7-89ff-dda2fa121ad9'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:32 user nova-compute[72520]: INFO os_vif [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04')
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:48:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No VIF found with MAC fa:16:3e:f1:5f:6f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:48:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-98f1eaf3-9c64-442a-9bcf-35737385e973 req-bab59690-1829-4c2d-8bd3-0631eaf05714 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-98f1eaf3-9c64-442a-9bcf-35737385e973 req-bab59690-1829-4c2d-8bd3-0631eaf05714 service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-98f1eaf3-9c64-442a-9bcf-35737385e973 req-bab59690-1829-4c2d-8bd3-0631eaf05714 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-98f1eaf3-9c64-442a-9bcf-35737385e973 req-bab59690-1829-4c2d-8bd3-0631eaf05714 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-98f1eaf3-9c64-442a-9bcf-35737385e973 req-bab59690-1829-4c2d-8bd3-0631eaf05714 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:48:34 user nova-compute[72520]: WARNING nova.compute.manager [req-98f1eaf3-9c64-442a-9bcf-35737385e973 req-bab59690-1829-4c2d-8bd3-0631eaf05714 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state building and task_state spawning.
Aug 02 23:48:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020116.1349185, a1103e2e-7595-4cb7-89ff-dda2fa121ad9 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:48:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] VM Resumed (Lifecycle Event)
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:48:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance spawned successfully.
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020116.1367736, a1103e2e-7595-4cb7-89ff-dda2fa121ad9 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:48:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] VM Started (Lifecycle Event)
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-5d29524d-334b-452f-abe9-290e5a77eeb8 req-b7490d0d-b67f-4a9f-8353-02044fc7f58f service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5d29524d-334b-452f-abe9-290e5a77eeb8 req-b7490d0d-b67f-4a9f-8353-02044fc7f58f service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5d29524d-334b-452f-abe9-290e5a77eeb8 req-b7490d0d-b67f-4a9f-8353-02044fc7f58f service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5d29524d-334b-452f-abe9-290e5a77eeb8 req-b7490d0d-b67f-4a9f-8353-02044fc7f58f service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-5d29524d-334b-452f-abe9-290e5a77eeb8 req-b7490d0d-b67f-4a9f-8353-02044fc7f58f service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:48:36 user nova-compute[72520]: WARNING nova.compute.manager [req-5d29524d-334b-452f-abe9-290e5a77eeb8 req-b7490d0d-b67f-4a9f-8353-02044fc7f58f service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state building and task_state spawning.
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:48:36 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:48:36 user nova-compute[72520]: INFO nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 02 23:48:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:36 user nova-compute[72520]: INFO nova.compute.manager [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Took 24.45 seconds to build instance.
Aug 02 23:48:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60d5825b-c616-43d6-b037-0e97ab0d394f tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.554s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:51 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:48:53 user nova-compute[72520]: INFO nova.compute.claims [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Claim successful on node user
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [{"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:48:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:48:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.policy [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79582888cd7f4b298477f7b894fb2271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4378f14a806b49909b771be46b36fa26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:48:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Creating image(s)
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "/opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "/opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.155s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk 1073741824" returned: 0 in 0.056s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Successfully created port: 8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Cannot resize image /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lazy-loading 'migration_context' on Instance uuid b6a28b99-39c3-4252-b256-c7233ba7eb7e {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Ensure instance console log exists: /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Successfully updated port: 8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "refresh_cache-b6a28b99-39c3-4252-b256-c7233ba7eb7e" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquired lock "refresh_cache-b6a28b99-39c3-4252-b256-c7233ba7eb7e" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received event network-changed-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Refreshing instance network info cache due to event network-changed-8dd99830-dc1b-40e1-8208-e2a2e4ad318d. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] Acquiring lock "refresh_cache-b6a28b99-39c3-4252-b256-c7233ba7eb7e" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:48:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Updating instance_info_cache with network_info: [{"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Releasing lock "refresh_cache-b6a28b99-39c3-4252-b256-c7233ba7eb7e" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Instance network_info: |[{"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] Acquired lock "refresh_cache-b6a28b99-39c3-4252-b256-c7233ba7eb7e" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.network.neutron [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Refreshing network info cache for port 8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Start _get_guest_xml network_info=[{"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:48:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:48:56 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1158749578',display_name='tempest-VolumesActionsTest-instance-1158749578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1158749578',id=31,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4378f14a806b49909b771be46b36fa26',ramdisk_id='',reservation_id='r-lcysk9i3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1758836648',owner_user_name='tempest-VolumesActionsTest-1758836648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:48:54Z,user_data=None,user_id='79582888cd7f4b298477f7b894fb2271',uuid=b6a28b99-39c3-4252-b256-c7233ba7eb7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Converting VIF {"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a9:ba,bridge_name='br-int',has_traffic_filtering=True,id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d,network=Network(386e2be2-0690-45fe-be1e-c03503916e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dd99830-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lazy-loading 'pci_devices' on Instance uuid b6a28b99-39c3-4252-b256-c7233ba7eb7e {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:48:56 user nova-compute[72520]:   <uuid>b6a28b99-39c3-4252-b256-c7233ba7eb7e</uuid>
Aug 02 23:48:56 user nova-compute[72520]:   <name>instance-0000001f</name>
Aug 02 23:48:56 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:48:56 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:48:56 user nova-compute[72520]:   <metadata>
Aug 02 23:48:56 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:48:56 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:48:56 user nova-compute[72520]:       <nova:name>tempest-VolumesActionsTest-instance-1158749578</nova:name>
Aug 02 23:48:56 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:48:56</nova:creationTime>
Aug 02 23:48:56 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:48:56 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:48:56 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:48:56 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:48:56 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:48:56 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:48:56 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:48:56 user nova-compute[72520]:       <nova:owner>
Aug 02 23:48:56 user nova-compute[72520]:         <nova:user uuid="79582888cd7f4b298477f7b894fb2271">tempest-VolumesActionsTest-1758836648-project-member</nova:user>
Aug 02 23:48:56 user nova-compute[72520]:         <nova:project uuid="4378f14a806b49909b771be46b36fa26">tempest-VolumesActionsTest-1758836648</nova:project>
Aug 02 23:48:56 user nova-compute[72520]:       </nova:owner>
Aug 02 23:48:56 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:48:56 user nova-compute[72520]:       <nova:ports>
Aug 02 23:48:56 user nova-compute[72520]:         <nova:port uuid="8dd99830-dc1b-40e1-8208-e2a2e4ad318d">
Aug 02 23:48:56 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 02 23:48:56 user nova-compute[72520]:         </nova:port>
Aug 02 23:48:56 user nova-compute[72520]:       </nova:ports>
Aug 02 23:48:56 user nova-compute[72520]:     </nova:instance>
Aug 02 23:48:56 user nova-compute[72520]:   </metadata>
Aug 02 23:48:56 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:48:56 user nova-compute[72520]:     <system>
Aug 02 23:48:56 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:48:56 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:48:56 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:48:56 user nova-compute[72520]:       <entry name="serial">b6a28b99-39c3-4252-b256-c7233ba7eb7e</entry>
Aug 02 23:48:56 user nova-compute[72520]:       <entry name="uuid">b6a28b99-39c3-4252-b256-c7233ba7eb7e</entry>
Aug 02 23:48:56 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:48:56 user nova-compute[72520]:     </system>
Aug 02 23:48:56 user nova-compute[72520]:   </sysinfo>
Aug 02 23:48:56 user nova-compute[72520]:   <os>
Aug 02 23:48:56 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:48:56 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:48:56 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:48:56 user nova-compute[72520]:   </os>
Aug 02 23:48:56 user nova-compute[72520]:   <features>
Aug 02 23:48:56 user nova-compute[72520]:     <acpi/>
Aug 02 23:48:56 user nova-compute[72520]:     <apic/>
Aug 02 23:48:56 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:48:56 user nova-compute[72520]:   </features>
Aug 02 23:48:56 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:48:56 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:48:56 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:48:56 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:48:56 user nova-compute[72520]:   </clock>
Aug 02 23:48:56 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:48:56 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:48:56 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:48:56 user nova-compute[72520]:   </cpu>
Aug 02 23:48:56 user nova-compute[72520]:   <devices>
Aug 02 23:48:56 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:48:56 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:48:56 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk"/>
Aug 02 23:48:56 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:48:56 user nova-compute[72520]:     </disk>
Aug 02 23:48:56 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:48:56 user nova-compute[72520]:       <mac address="fa:16:3e:b5:a9:ba"/>
Aug 02 23:48:56 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:48:56 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:48:56 user nova-compute[72520]:       <target dev="tap8dd99830-dc"/>
Aug 02 23:48:56 user nova-compute[72520]:     </interface>
Aug 02 23:48:56 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:48:56 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/console.log" append="off"/>
Aug 02 23:48:56 user nova-compute[72520]:     </serial>
Aug 02 23:48:56 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:48:56 user nova-compute[72520]:     <video>
Aug 02 23:48:56 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:48:56 user nova-compute[72520]:     </video>
Aug 02 23:48:56 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:48:56 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:48:56 user nova-compute[72520]:     </rng>
Aug 02 23:48:56 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:48:56 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:48:56 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:48:56 user nova-compute[72520]:     </memballoon>
Aug 02 23:48:56 user nova-compute[72520]:   </devices>
Aug 02 23:48:56 user nova-compute[72520]: </domain>
Aug 02 23:48:56 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1158749578',display_name='tempest-VolumesActionsTest-instance-1158749578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1158749578',id=31,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4378f14a806b49909b771be46b36fa26',ramdisk_id='',reservation_id='r-lcysk9i3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1758836648',owner_user_name='tempest-VolumesActionsTest-1758836648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:48:54Z,user_data=None,user_id='79582888cd7f4b298477f7b894fb2271',uuid=b6a28b99-39c3-4252-b256-c7233ba7eb7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Converting VIF {"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a9:ba,bridge_name='br-int',has_traffic_filtering=True,id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d,network=Network(386e2be2-0690-45fe-be1e-c03503916e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dd99830-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG os_vif [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a9:ba,bridge_name='br-int',has_traffic_filtering=True,id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d,network=Network(386e2be2-0690-45fe-be1e-c03503916e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dd99830-dc') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8dd99830-dc, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8dd99830-dc, col_values=(('external_ids', {'iface-id': '8dd99830-dc1b-40e1-8208-e2a2e4ad318d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:a9:ba', 'vm-uuid': 'b6a28b99-39c3-4252-b256-c7233ba7eb7e'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:56 user nova-compute[72520]: INFO os_vif [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a9:ba,bridge_name='br-int',has_traffic_filtering=True,id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d,network=Network(386e2be2-0690-45fe-be1e-c03503916e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dd99830-dc')
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] No VIF found with MAC fa:16:3e:b5:a9:ba, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.network.neutron [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Updated VIF entry in instance network info cache for port 8dd99830-dc1b-40e1-8208-e2a2e4ad318d. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG nova.network.neutron [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Updating instance_info_cache with network_info: [{"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:48:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ddda710-e98a-40d9-8535-943da4061256 req-74557b97-d8ce-4465-ae87-3a72645e571b service nova] Releasing lock "refresh_cache-b6a28b99-39c3-4252-b256-c7233ba7eb7e" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-a2c2d5c6-70d6-45f2-8a48-d62c951bf4cf req-e87cacbe-3eb2-41a2-abf6-2be116265c34 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received event network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2c2d5c6-70d6-45f2-8a48-d62c951bf4cf req-e87cacbe-3eb2-41a2-abf6-2be116265c34 service nova] Acquiring lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2c2d5c6-70d6-45f2-8a48-d62c951bf4cf req-e87cacbe-3eb2-41a2-abf6-2be116265c34 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2c2d5c6-70d6-45f2-8a48-d62c951bf4cf req-e87cacbe-3eb2-41a2-abf6-2be116265c34 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:48:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-a2c2d5c6-70d6-45f2-8a48-d62c951bf4cf req-e87cacbe-3eb2-41a2-abf6-2be116265c34 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] No waiting events found dispatching network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:48:57 user nova-compute[72520]: WARNING nova.compute.manager [req-a2c2d5c6-70d6-45f2-8a48-d62c951bf4cf req-e87cacbe-3eb2-41a2-abf6-2be116265c34 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received unexpected event network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d for instance with vm_state building and task_state spawning.
Aug 02 23:48:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020139.9328473, b6a28b99-39c3-4252-b256-c7233ba7eb7e => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:48:59 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] VM Resumed (Lifecycle Event)
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:48:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Instance spawned successfully.
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:48:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:49:00 user nova-compute[72520]: INFO nova.compute.manager [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Unrescuing
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquired lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:49:00 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020139.93606, b6a28b99-39c3-4252-b256-c7233ba7eb7e => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:49:00 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] VM Started (Lifecycle Event)
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-e1a663d6-0d57-463f-a7c4-5ba0b69ffb83 req-679ad6d6-9db5-426c-aeaa-e3b4b874b461 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received event network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e1a663d6-0d57-463f-a7c4-5ba0b69ffb83 req-679ad6d6-9db5-426c-aeaa-e3b4b874b461 service nova] Acquiring lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e1a663d6-0d57-463f-a7c4-5ba0b69ffb83 req-679ad6d6-9db5-426c-aeaa-e3b4b874b461 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e1a663d6-0d57-463f-a7c4-5ba0b69ffb83 req-679ad6d6-9db5-426c-aeaa-e3b4b874b461 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-e1a663d6-0d57-463f-a7c4-5ba0b69ffb83 req-679ad6d6-9db5-426c-aeaa-e3b4b874b461 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] No waiting events found dispatching network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:00 user nova-compute[72520]: WARNING nova.compute.manager [req-e1a663d6-0d57-463f-a7c4-5ba0b69ffb83 req-679ad6d6-9db5-426c-aeaa-e3b4b874b461 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received unexpected event network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d for instance with vm_state building and task_state spawning.
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:49:00 user nova-compute[72520]: INFO nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:00 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:49:00 user nova-compute[72520]: INFO nova.compute.manager [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Took 6.79 seconds to build instance.
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6d83c4a7-f31c-4017-b07e-d52340920498 tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.934s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Releasing lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'flavor' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-79ef67f9-66e4-495a-8b5d-6a80dd9d49a3 req-05eab5c6-ec05-49e3-9994-353edd2e8717 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-79ef67f9-66e4-495a-8b5d-6a80dd9d49a3 req-05eab5c6-ec05-49e3-9994-353edd2e8717 service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-79ef67f9-66e4-495a-8b5d-6a80dd9d49a3 req-05eab5c6-ec05-49e3-9994-353edd2e8717 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-79ef67f9-66e4-495a-8b5d-6a80dd9d49a3 req-05eab5c6-ec05-49e3-9994-353edd2e8717 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-79ef67f9-66e4-495a-8b5d-6a80dd9d49a3 req-05eab5c6-ec05-49e3-9994-353edd2e8717 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:00 user nova-compute[72520]: WARNING nova.compute.manager [req-79ef67f9-66e4-495a-8b5d-6a80dd9d49a3 req-05eab5c6-ec05-49e3-9994-353edd2e8717 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:49:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:01 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance destroyed successfully.
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:03 user nova-compute[72520]: WARNING nova.compute.manager [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:49:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:03 user nova-compute[72520]: WARNING nova.compute.manager [req-96c468f8-da77-4ed9-bd6b-c7ce4ed30dc4 req-d63618d9-8091-4d85-84d2-b6b15fce3d01 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:04 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:49:04 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7547MB free_disk=25.25206756591797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 982bd91f-8b1a-41b2-ad23-3d31136de392 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a1103e2e-7595-4cb7-89ff-dda2fa121ad9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b6a28b99-39c3-4252-b256-c7233ba7eb7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:49:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-c356da26-2b51-4f10-bedb-f7ecb2d98816 req-dc47e878-a7a0-4738-91d9-aa5569e38a46 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c356da26-2b51-4f10-bedb-f7ecb2d98816 req-dc47e878-a7a0-4738-91d9-aa5569e38a46 service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c356da26-2b51-4f10-bedb-f7ecb2d98816 req-dc47e878-a7a0-4738-91d9-aa5569e38a46 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c356da26-2b51-4f10-bedb-f7ecb2d98816 req-dc47e878-a7a0-4738-91d9-aa5569e38a46 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-c356da26-2b51-4f10-bedb-f7ecb2d98816 req-dc47e878-a7a0-4738-91d9-aa5569e38a46 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:05 user nova-compute[72520]: WARNING nova.compute.manager [req-c356da26-2b51-4f10-bedb-f7ecb2d98816 req-dc47e878-a7a0-4738-91d9-aa5569e38a46 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9971210f-576b-4e98-94c0-af4a67e2a811 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020145.1655042, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:49:05 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] VM Resumed (Lifecycle Event)
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:49:05 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020145.1671004, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:49:05 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] VM Started (Lifecycle Event)
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:49:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-changed-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Refreshing instance network info cache due to event network-changed-ad1bea50-6df7-41da-b7db-48366aeb40b3. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:49:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] Acquiring lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:49:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] Acquired lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:49:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Refreshing network info cache for port ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:49:15 user nova-compute[72520]: DEBUG nova.network.neutron [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updated VIF entry in instance network info cache for port ad1bea50-6df7-41da-b7db-48366aeb40b3. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:49:15 user nova-compute[72520]: DEBUG nova.network.neutron [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:49:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a98111af-4cb1-4d43-9837-fb6b76804be8 req-bc803913-026b-4a3a-b105-04e6b5d3e4c7 service nova] Releasing lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Stashing vm_state: active {{(pid=72520) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-changed-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Refreshing instance network info cache due to event network-changed-06065754-8489-41bd-acb5-f264f5633570. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] Acquiring lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] Acquired lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG nova.network.neutron [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Refreshing network info cache for port 06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:16 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'pci_requests' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:49:17 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:49:17 user nova-compute[72520]: INFO nova.compute.claims [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Claim successful on node user
Aug 02 23:49:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'resources' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:49:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'pci_devices' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:49:17 user nova-compute[72520]: INFO nova.compute.resource_tracker [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating resource usage from migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d
Aug 02 23:49:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updated VIF entry in instance network info cache for port 06065754-8489-41bd-acb5-f264f5633570. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:49:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:49:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3699e6e7-1e5d-405e-9782-873e52147968 req-84e2ab7d-0bd0-49ad-a291-e4de7d9e9ce8 service nova] Releasing lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.141s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:18 user nova-compute[72520]: INFO nova.compute.manager [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Migrating
Aug 02 23:49:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:49:18 user nova-compute[72520]: INFO nova.compute.rpcapi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 02 23:49:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquired lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Releasing lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Starting migrate_disk_and_power_off {{(pid=72520) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:19 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance destroyed successfully.
Aug 02 23:49:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1912665491',display_name='tempest-ServerActionsTestOtherA-server-1912665491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1912665491',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-oyl88jgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:49:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=982bd91f-8b1a-41b2-ad23-3d31136de392,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1507770911-network", "vif_mac": "fa:16:3e:35:1c:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1507770911-network", "vif_mac": "fa:16:3e:35:1c:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_vif [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b38df96-0bc1-45d8-8e20-1f7ee13e9e8e req-6235efa3-5c71-4242-9988-5d87bbd99648 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-unplugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b38df96-0bc1-45d8-8e20-1f7ee13e9e8e req-6235efa3-5c71-4242-9988-5d87bbd99648 service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b38df96-0bc1-45d8-8e20-1f7ee13e9e8e req-6235efa3-5c71-4242-9988-5d87bbd99648 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1b38df96-0bc1-45d8-8e20-1f7ee13e9e8e req-6235efa3-5c71-4242-9988-5d87bbd99648 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-1b38df96-0bc1-45d8-8e20-1f7ee13e9e8e req-6235efa3-5c71-4242-9988-5d87bbd99648 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-unplugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:19 user nova-compute[72520]: WARNING nova.compute.manager [req-1b38df96-0bc1-45d8-8e20-1f7ee13e9e8e req-6235efa3-5c71-4242-9988-5d87bbd99648 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received unexpected event network-vif-unplugged-06065754-8489-41bd-acb5-f264f5633570 for instance with vm_state active and task_state resize_migrating.
Aug 02 23:49:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06065754-84, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:49:19 user nova-compute[72520]: INFO os_vif [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84')
Aug 02 23:49:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:49:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4efe254-c6d9-4c5c-b2b0-8b75508b458e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ccf063-cd9e-4ee0-949a-b9b8910c4c9a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:19 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:19 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:19 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:19 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:19 user nova-compute[72520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:19 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce45c8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c34d08-8ef8-434a-9bcf-c0cc94e2aafb]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f027d1-61fa-4f80-a05d-f8c55f7ff60b]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c6d426-7a15-4e19-84dd-e3ad8b04c363]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec332428-8099-4f7a-8873-40c434bbdd7b]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_194f077', '/dev/disk/by-id/scsi-1SCST_BIO194f077-1159c01c6cc92ba3', '/dev/disk/by-id/scsi-23131353963303163') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26467e-39e8-4fd1-b175-b3ac12d054dc]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b71482c-235e-4e29-b4c5-f7c15fe7d64b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[585bc359-62b3-4b95-8655-aabed579337c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]
Aug 02 23:49:20 user nova-compute[72520]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.
Aug 02 23:49:20 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9dd552-8718-4558-9b9c-fc9541e63b11]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== disconnect_volume: return (375ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:49:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Port 06065754-8489-41bd-acb5-f264f5633570 binding to destination host user is already ACTIVE {{(pid=72520) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquired lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Releasing lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-3fa8958f-c831-4bfe-a36c-20fd2ea2ba68 req-a8e556a6-4d81-41e9-82b1-7e55c4af167f service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fa8958f-c831-4bfe-a36c-20fd2ea2ba68 req-a8e556a6-4d81-41e9-82b1-7e55c4af167f service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fa8958f-c831-4bfe-a36c-20fd2ea2ba68 req-a8e556a6-4d81-41e9-82b1-7e55c4af167f service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3fa8958f-c831-4bfe-a36c-20fd2ea2ba68 req-a8e556a6-4d81-41e9-82b1-7e55c4af167f service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-3fa8958f-c831-4bfe-a36c-20fd2ea2ba68 req-a8e556a6-4d81-41e9-82b1-7e55c4af167f service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:21 user nova-compute[72520]: WARNING nova.compute.manager [req-3fa8958f-c831-4bfe-a36c-20fd2ea2ba68 req-a8e556a6-4d81-41e9-82b1-7e55c4af167f service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received unexpected event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 for instance with vm_state active and task_state resize_migrated.
Aug 02 23:49:21 user nova-compute[72520]: DEBUG os_brick.utils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8129e05-d73d-467d-a0fc-eacdc6939456]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2eaade-ba30-410c-9313-4054d675ce0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a01c23c-65a9-412a-84a8-109e5c9f7d84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7b1b6b-e5e0-4bca-b3ca-d2df1e4b75cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:49:21 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:49:21 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7998282c-55fb-4cc6-a2ea-e8ffd6f248c5]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:49:21 user nova-compute[72520]: DEBUG os_brick.utils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:49:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Starting finish_migration {{(pid=72520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 02 23:49:29 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Creating image(s)
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Ensure instance console log exists: /opt/stack/data/nova/instances/982bd91f-8b1a-41b2-ad23-3d31136de392/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Start _get_guest_xml network_info=[{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1507770911-network", "vif_mac": "fa:16:3e:35:1c:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '982bd91f-8b1a-41b2-ad23-3d31136de392', 'attached_at': '2023-08-02T23:49:30.000000', 'detached_at': '', 'volume_id': '91d325d2-c6a9-4a72-a5e9-a45c3d645fca', 'serial': '91d325d2-c6a9-4a72-a5e9-a45c3d645fca'}, 'attachment_id': '6bfe36aa-47ef-4446-9a1b-c05e76cd484c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:49:29 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:49:29 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:49:29 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'vcpu_model' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:49:30 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:49:30 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:49:30 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3468bc51-5123-4c3c-8ad7-92b2720aef20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:49:30 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e8d5b2-3f8a-4a43-b894-f5d1a4a2ab22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca] added
Aug 02 23:49:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd69a801-1140-4e39-80cf-753089d5956f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b468b752-91ba-42e7-8a30-15521a08ca46]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtCpHbcJ {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtCpHbcJ" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eab4e7a-c8b4-42d1-896e-9023df195edc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jtCpHbcJ'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0be458-0d67-4f95-835f-3422fab6fba7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e726be-9899-4f7e-af60-00adbe9d29da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef9b76-3c8d-4de4-b870-4c7577923157]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]
Aug 02 23:49:30 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.
Aug 02 23:49:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab19ebb-bc1e-4412-b250-4bf51ad43f22]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[637dafb7-e760-4431-be36-cfe4b3c0c7f8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:30 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a33b15-3602-4599-bdc9-3c9f0518ae59]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23131353963303163', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131353963303163', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1912665491',display_name='tempest-ServerActionsTestOtherA-server-1912665491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1912665491',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-oyl88jgm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=982bd91f-8b1a-41b2-ad23-3d31136de392,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1507770911-network", "vif_mac": "fa:16:3e:35:1c:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1507770911-network", "vif_mac": "fa:16:3e:35:1c:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:49:31 user nova-compute[72520]:   <uuid>982bd91f-8b1a-41b2-ad23-3d31136de392</uuid>
Aug 02 23:49:31 user nova-compute[72520]:   <name>instance-0000001c</name>
Aug 02 23:49:31 user nova-compute[72520]:   <memory>2097152</memory>
Aug 02 23:49:31 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:49:31 user nova-compute[72520]:   <metadata>
Aug 02 23:49:31 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:49:31 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:49:31 user nova-compute[72520]:       <nova:name>tempest-ServerActionsTestOtherA-server-1912665491</nova:name>
Aug 02 23:49:31 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:49:29</nova:creationTime>
Aug 02 23:49:31 user nova-compute[72520]:       <nova:flavor name="m1.small">
Aug 02 23:49:31 user nova-compute[72520]:         <nova:memory>2048</nova:memory>
Aug 02 23:49:31 user nova-compute[72520]:         <nova:disk>20</nova:disk>
Aug 02 23:49:31 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:49:31 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:49:31 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:49:31 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:49:31 user nova-compute[72520]:       <nova:owner>
Aug 02 23:49:31 user nova-compute[72520]:         <nova:user uuid="e4848df27d404a9eb33ec7e7dd45dd12">tempest-ServerActionsTestOtherA-102203488-project-member</nova:user>
Aug 02 23:49:31 user nova-compute[72520]:         <nova:project uuid="c2f50f35e2b7466ea2a922b0525b2fb1">tempest-ServerActionsTestOtherA-102203488</nova:project>
Aug 02 23:49:31 user nova-compute[72520]:       </nova:owner>
Aug 02 23:49:31 user nova-compute[72520]:       <nova:ports>
Aug 02 23:49:31 user nova-compute[72520]:         <nova:port uuid="06065754-8489-41bd-acb5-f264f5633570">
Aug 02 23:49:31 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 02 23:49:31 user nova-compute[72520]:         </nova:port>
Aug 02 23:49:31 user nova-compute[72520]:       </nova:ports>
Aug 02 23:49:31 user nova-compute[72520]:     </nova:instance>
Aug 02 23:49:31 user nova-compute[72520]:   </metadata>
Aug 02 23:49:31 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:49:31 user nova-compute[72520]:     <system>
Aug 02 23:49:31 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:49:31 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:49:31 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:49:31 user nova-compute[72520]:       <entry name="serial">982bd91f-8b1a-41b2-ad23-3d31136de392</entry>
Aug 02 23:49:31 user nova-compute[72520]:       <entry name="uuid">982bd91f-8b1a-41b2-ad23-3d31136de392</entry>
Aug 02 23:49:31 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:49:31 user nova-compute[72520]:     </system>
Aug 02 23:49:31 user nova-compute[72520]:   </sysinfo>
Aug 02 23:49:31 user nova-compute[72520]:   <os>
Aug 02 23:49:31 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:49:31 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:49:31 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:49:31 user nova-compute[72520]:   </os>
Aug 02 23:49:31 user nova-compute[72520]:   <features>
Aug 02 23:49:31 user nova-compute[72520]:     <acpi/>
Aug 02 23:49:31 user nova-compute[72520]:     <apic/>
Aug 02 23:49:31 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:49:31 user nova-compute[72520]:   </features>
Aug 02 23:49:31 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:49:31 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:49:31 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:49:31 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:49:31 user nova-compute[72520]:   </clock>
Aug 02 23:49:31 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:49:31 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:49:31 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:49:31 user nova-compute[72520]:   </cpu>
Aug 02 23:49:31 user nova-compute[72520]:   <devices>
Aug 02 23:49:31 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:49:31 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:49:31 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 02 23:49:31 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:49:31 user nova-compute[72520]:       <serial>91d325d2-c6a9-4a72-a5e9-a45c3d645fca</serial>
Aug 02 23:49:31 user nova-compute[72520]:     </disk>
Aug 02 23:49:31 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:49:31 user nova-compute[72520]:       <mac address="fa:16:3e:35:1c:34"/>
Aug 02 23:49:31 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:49:31 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:49:31 user nova-compute[72520]:       <target dev="tap06065754-84"/>
Aug 02 23:49:31 user nova-compute[72520]:     </interface>
Aug 02 23:49:31 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:49:31 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/982bd91f-8b1a-41b2-ad23-3d31136de392/console.log" append="off"/>
Aug 02 23:49:31 user nova-compute[72520]:     </serial>
Aug 02 23:49:31 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:49:31 user nova-compute[72520]:     <video>
Aug 02 23:49:31 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:49:31 user nova-compute[72520]:     </video>
Aug 02 23:49:31 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:49:31 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:49:31 user nova-compute[72520]:     </rng>
Aug 02 23:49:31 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:49:31 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:49:31 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:49:31 user nova-compute[72520]:     </memballoon>
Aug 02 23:49:31 user nova-compute[72520]:   </devices>
Aug 02 23:49:31 user nova-compute[72520]: </domain>
Aug 02 23:49:31 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1912665491',display_name='tempest-ServerActionsTestOtherA-server-1912665491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1912665491',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-oyl88jgm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=982bd91f-8b1a-41b2-ad23-3d31136de392,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1507770911-network", "vif_mac": "fa:16:3e:35:1c:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1507770911-network", "vif_mac": "fa:16:3e:35:1c:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG os_vif [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06065754-84, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06065754-84, col_values=(('external_ids', {'iface-id': '06065754-8489-41bd-acb5-f264f5633570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:1c:34', 'vm-uuid': '982bd91f-8b1a-41b2-ad23-3d31136de392'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:31 user nova-compute[72520]: INFO os_vif [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84')
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:49:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] No VIF found with MAC fa:16:3e:35:1c:34, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:49:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-590ae2f3-0958-4313-a1fe-9d4fb35cf29f req-2202e152-11c7-4e25-8fb0-e927d2a112f0 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-590ae2f3-0958-4313-a1fe-9d4fb35cf29f req-2202e152-11c7-4e25-8fb0-e927d2a112f0 service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-590ae2f3-0958-4313-a1fe-9d4fb35cf29f req-2202e152-11c7-4e25-8fb0-e927d2a112f0 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-590ae2f3-0958-4313-a1fe-9d4fb35cf29f req-2202e152-11c7-4e25-8fb0-e927d2a112f0 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-590ae2f3-0958-4313-a1fe-9d4fb35cf29f req-2202e152-11c7-4e25-8fb0-e927d2a112f0 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:33 user nova-compute[72520]: WARNING nova.compute.manager [req-590ae2f3-0958-4313-a1fe-9d4fb35cf29f req-2202e152-11c7-4e25-8fb0-e927d2a112f0 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received unexpected event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 for instance with vm_state active and task_state resize_finish.
Aug 02 23:49:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020159.6866918, 982bd91f-8b1a-41b2-ad23-3d31136de392 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:49:34 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] VM Stopped (Lifecycle Event)
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-498340b4-8086-4580-b9d9-106677e763e9 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020174.8995178, 982bd91f-8b1a-41b2-ad23-3d31136de392 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:49:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] VM Resumed (Lifecycle Event)
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:49:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance running successfully.
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Failed to set time: agent not configured {{(pid=72520) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a49a39-58e2-41d0-8368-dbf351223e8c tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] finish_migration finished successfully. {{(pid=72520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:49:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020174.901375, 982bd91f-8b1a-41b2-ad23-3d31136de392 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:49:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] VM Started (Lifecycle Event)
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:49:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:49:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 02 23:49:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-d2944827-1eb9-4217-b8e4-909e757f8be2 req-94ad5c7a-f20d-43e2-aa0e-de58dec2fa47 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:49:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d2944827-1eb9-4217-b8e4-909e757f8be2 req-94ad5c7a-f20d-43e2-aa0e-de58dec2fa47 service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d2944827-1eb9-4217-b8e4-909e757f8be2 req-94ad5c7a-f20d-43e2-aa0e-de58dec2fa47 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d2944827-1eb9-4217-b8e4-909e757f8be2 req-94ad5c7a-f20d-43e2-aa0e-de58dec2fa47 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-d2944827-1eb9-4217-b8e4-909e757f8be2 req-94ad5c7a-f20d-43e2-aa0e-de58dec2fa47 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:49:35 user nova-compute[72520]: WARNING nova.compute.manager [req-d2944827-1eb9-4217-b8e4-909e757f8be2 req-94ad5c7a-f20d-43e2-aa0e-de58dec2fa47 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received unexpected event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 for instance with vm_state active and task_state resize_finish.
Aug 02 23:49:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG nova.objects.instance [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'flavor' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:48 user nova-compute[72520]: INFO nova.compute.manager [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Attaching volume 8c81da47-89de-48e1-9591-89e32de627e0 to /dev/vdb
Aug 02 23:49:48 user nova-compute[72520]: DEBUG os_brick.utils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06687c6d-b6fb-4c72-95da-fd25d1f70bad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec1381a-f965-464a-8791-710410f83d8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[880dfd27-b852-45f5-b1ae-39c0b8750161]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[68376cfa-b21d-4ddd-8ac9-25bf7f2cb6da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:49:48 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:49:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f65665-d7e1-4e19-b04a-18c3c4dd6ba2]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG os_brick.utils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating existing volume attachment record: 3660a6de-2bbd-4c8c-bac4-e62fbf820532 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:49:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:53 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updating instance_info_cache with network_info: [{"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-23931909-81f4-44fb-b936-10a27c16febb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:49:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:55 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgJQbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:49:56 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:49:56 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:49:56 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd9ff08-e6d1-4a2f-8c35-dcc6cbeb8e56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:49:56 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[262cd8d9-3010-4b17-a125-dff7d9c9a044]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0] added
Aug 02 23:49:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dfced3-8493-4f2b-b0b0-50452914e705]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29923db-3806-4e52-89f5-a6df539f890d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liSgJQbD {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liSgJQbD" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[673a9928-30de-4923-a64a-3e63737a611a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'liSgJQbD'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f343538b-f396-4b77-82ed-ab62c02860b0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a93a8aa-ebb2-4024-ab42-58c6c6253794]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbe08f3-2d39-4969-8b4c-bccb51dde395]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]
Aug 02 23:49:56 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.
Aug 02 23:49:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e238c44-05bf-4f95-af63-0b1bf28f1ebb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfbd1ad-5e89-421d-b4f6-b3a0efa01f20]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:49:56 user nova-compute[72520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:49:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d08e29-91b6-4ab7-b568-f0443de2f66b]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:49:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgJQbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23564633438653363', 'path': '/dev/sdf'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564633438653363', 'path': '/dev/sdf'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'flavor' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:49:57 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:49:57 user nova-compute[72520]:   <source dev="/dev/sdf"/>
Aug 02 23:49:57 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:49:57 user nova-compute[72520]:   <serial>8c81da47-89de-48e1-9591-89e32de627e0</serial>
Aug 02 23:49:57 user nova-compute[72520]: </disk>
Aug 02 23:49:57 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:49:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No VIF found with MAC fa:16:3e:f9:fe:42, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-41e69cd0-424d-485e-a0f9-7c50b8536e48 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.726s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:49:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:50:00 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:50:00 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7423MB free_disk=25.219341278076172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Applying migration context for instance 982bd91f-8b1a-41b2-ad23-3d31136de392 as it has an incoming, in-progress migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d. Migration status is finished {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 02 23:50:00 user nova-compute[72520]: INFO nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating resource usage from migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a1103e2e-7595-4cb7-89ff-dda2fa121ad9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b6a28b99-39c3-4252-b256-c7233ba7eb7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 982bd91f-8b1a-41b2-ad23-3d31136de392 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:50:00 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:50:01 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:50:01 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:50:01 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:50:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:03 user nova-compute[72520]: INFO nova.compute.manager [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Rescuing
Aug 02 23:50:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG nova.network.neutron [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG nova.network.neutron [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updating instance_info_cache with network_info: [{"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-cf818d55-e05d-4c93-a387-7e6bb868fe39 req-6132d0f1-2e35-4620-94da-c6942111a066 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cf818d55-e05d-4c93-a387-7e6bb868fe39 req-6132d0f1-2e35-4620-94da-c6942111a066 service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cf818d55-e05d-4c93-a387-7e6bb868fe39 req-6132d0f1-2e35-4620-94da-c6942111a066 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cf818d55-e05d-4c93-a387-7e6bb868fe39 req-6132d0f1-2e35-4620-94da-c6942111a066 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-cf818d55-e05d-4c93-a387-7e6bb868fe39 req-6132d0f1-2e35-4620-94da-c6942111a066 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:04 user nova-compute[72520]: WARNING nova.compute.manager [req-cf818d55-e05d-4c93-a387-7e6bb868fe39 req-6132d0f1-2e35-4620-94da-c6942111a066 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state active and task_state rescuing.
Aug 02 23:50:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance destroyed successfully.
Aug 02 23:50:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Attempting a stable device rescue
Aug 02 23:50:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 02 23:50:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Creating image(s)
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "/opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'trusted_certs' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "c9dafebb7f01e1ae10d21f0e16b9692effc00392" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "c9dafebb7f01e1ae10d21f0e16b9692effc00392" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.part --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:05 user nova-compute[72520]: DEBUG nova.virt.images [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] 5fff36a3-de4a-4e8d-9ef8-dc36fb15aa2e was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:50:05 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:50:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.part /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e574a83-dc28-4b66-9434-b6d609c54dad req-c2814413-7b1f-40bc-83e0-93565cffdea7 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e574a83-dc28-4b66-9434-b6d609c54dad req-c2814413-7b1f-40bc-83e0-93565cffdea7 service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e574a83-dc28-4b66-9434-b6d609c54dad req-c2814413-7b1f-40bc-83e0-93565cffdea7 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e574a83-dc28-4b66-9434-b6d609c54dad req-c2814413-7b1f-40bc-83e0-93565cffdea7 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e574a83-dc28-4b66-9434-b6d609c54dad req-c2814413-7b1f-40bc-83e0-93565cffdea7 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:06 user nova-compute[72520]: WARNING nova.compute.manager [req-6e574a83-dc28-4b66-9434-b6d609c54dad req-c2814413-7b1f-40bc-83e0-93565cffdea7 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state active and task_state rescuing.
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.part /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.converted" returned: 0 in 0.427s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "c9dafebb7f01e1ae10d21f0e16b9692effc00392" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.789s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "c9dafebb7f01e1ae10d21f0e16b9692effc00392" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "c9dafebb7f01e1ae10d21f0e16b9692effc00392" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392 --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392,backing_fmt=raw /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.rescue {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392,backing_fmt=raw /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.rescue" returned: 0 in 0.045s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "c9dafebb7f01e1ae10d21f0e16b9692effc00392" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'migration_context' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Start _get_guest_xml network_info=[{"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "vif_mac": "fa:16:3e:f1:5f:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5fff36a3-de4a-4e8d-9ef8-dc36fb15aa2e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgcVhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a1103e2e-7595-4cb7-89ff-dda2fa121ad9', 'attached_at': '', 'detached_at': '', 'volume_id': '39e22842-5ac4-43df-bb63-d31dba32bf7d', 'serial': '39e22842-5ac4-43df-bb63-d31dba32bf7d'}, 'attachment_id': '05656e28-e743-42f1-a719-cbdcac879882', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'resources' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'numa_topology' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:06 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:50:06 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-changed-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing instance network info cache due to event network-changed-cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] Acquiring lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] Acquired lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing network info cache for port cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgcVhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:50:06 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:50:06 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:50:06 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a1f74b-4f66-44b0-b685-e727cbfb94f4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UMgcVhOn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 02 23:50:06 user nova-compute[72520]: node.name = iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d
Aug 02 23:50:06 user nova-compute[72520]: node.tpgt = -1
Aug 02 23:50:06 user nova-compute[72520]: node.startup = automatic
Aug 02 23:50:06 user nova-compute[72520]: node.leading_login = No
Aug 02 23:50:06 user nova-compute[72520]: iface.iscsi_ifacename = default
Aug 02 23:50:06 user nova-compute[72520]: iface.net_ifacename = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.ipaddress = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.prefix_len = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.hwaddress = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.transport_name = tcp
Aug 02 23:50:06 user nova-compute[72520]: iface.initiatorname = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.state = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.vlan_id = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.vlan_priority = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.vlan_state = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.iface_num = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.mtu = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.port = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.bootproto = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.subnet_mask = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.gateway = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_alt_client_id_state = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_alt_client_id = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_dns = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_learn_iqn = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_req_vendor_id_state = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_vendor_id_state = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_vendor_id = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.dhcp_slp_da = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.fragmentation = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.gratuitous_arp = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.incoming_forwarding = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.tos_state = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.tos = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.ttl = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.delayed_ack = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.tcp_nagle = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.tcp_wsf_state = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.tcp_wsf = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.tcp_timer_scale = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.tcp_timestamp = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.redirect = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.def_task_mgmt_timeout = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.header_digest = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.data_digest = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.immediate_data = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.initial_r2t = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.data_seq_inorder = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.data_pdu_inorder = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.erl = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.max_receive_data_len = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.first_burst_len = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.max_outstanding_r2t = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.max_burst_len = 0
Aug 02 23:50:06 user nova-compute[72520]: iface.chap_auth = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.bidi_chap = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.strict_login_compliance = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.discovery_auth = <empty>
Aug 02 23:50:06 user nova-compute[72520]: iface.discovery_logout = <empty>
Aug 02 23:50:06 user nova-compute[72520]: node.discovery_address = <empty>
Aug 02 23:50:06 user nova-compute[72520]: node.discovery_port = 0
Aug 02 23:50:06 user nova-compute[72520]: node.discovery_type = static
Aug 02 23:50:06 user nova-compute[72520]: node.session.initial_cmdsn = 0
Aug 02 23:50:06 user nova-compute[72520]: node.session.initial_login_retry_max = 8
Aug 02 23:50:06 user nova-compute[72520]: node.session.xmit_thread_priority = -20
Aug 02 23:50:06 user nova-compute[72520]: node.session.cmds_max = 128
Aug 02 23:50:06 user nova-compute[72520]: node.session.queue_depth = 32
Aug 02 23:50:06 user nova-compute[72520]: node.session.nr_sessions = 1
Aug 02 23:50:06 user nova-compute[72520]: node.session.auth.authmethod = CHAP
Aug 02 23:50:06 user nova-compute[72520]: node.session.auth.username = UMgcVhOn
Aug 02 23:50:06 user nova-compute[72520]: node.session.auth.password = ***
Aug 02 23:50:06 user nova-compute[72520]: node.session.auth.username_in = <empty>
Aug 02 23:50:06 user nova-compute[72520]: node.session.auth.password_in = <empty>
Aug 02 23:50:06 user nova-compute[72520]: node.session.auth.chap_algs = MD5
Aug 02 23:50:06 user nova-compute[72520]: node.session.timeo.replacement_timeout = 120
Aug 02 23:50:06 user nova-compute[72520]: node.session.err_timeo.abort_timeout = 15
Aug 02 23:50:06 user nova-compute[72520]: node.session.err_timeo.lu_reset_timeout = 30
Aug 02 23:50:06 user nova-compute[72520]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 02 23:50:06 user nova-compute[72520]: node.session.err_timeo.host_reset_timeout = 60
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.FastAbort = Yes
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.InitialR2T = No
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.ImmediateData = Yes
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.FirstBurstLength = 262144
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.MaxBurstLength = 16776192
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.DefaultTime2Retain = 0
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.DefaultTime2Wait = 2
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.MaxConnections = 1
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 02 23:50:06 user nova-compute[72520]: node.session.iscsi.ERL = 0
Aug 02 23:50:06 user nova-compute[72520]: node.session.scan = manual
Aug 02 23:50:06 user nova-compute[72520]: node.session.reopen_max = 0
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].address = 172.16.0.220
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].port = 3260
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].startup = manual
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].tcp.window_size = 524288
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].tcp.type_of_service = 0
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].timeo.logout_timeout = 15
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].timeo.login_timeout = 15
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].timeo.auth_timeout = 45
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].timeo.noop_out_interval = 5
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].timeo.noop_out_timeout = 5
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].iscsi.HeaderDigest = None
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].iscsi.DataDigest = None
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].iscsi.IFMarker = No
Aug 02 23:50:06 user nova-compute[72520]: node.conn[0].iscsi.OFMarker = No
Aug 02 23:50:06 user nova-compute[72520]: # END RECORD
Aug 02 23:50:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d29c84-8be9-4622-92ee-21130d2f800b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[329a3d12-e704-444f-b6cd-931708ac3acf]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMgcVhOn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMgcVhOn" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc5368-1dc7-4116-a439-fa0340980394]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMgcVhOn'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[900475d9-5a51-4d46-8bab-c8c49577e9ce]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[733593df-b0a7-4694-a5d4-803c40dd26c7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:06 user nova-compute[72520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] HCTL ('36', '0', '0', 0) found on session 37 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c679ad80-6166-4b79-a008-eccc6435ed81]: (4, ('0 0 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Searching for a device in session 37 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgcVhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23466623333356134', 'path': '/dev/sde'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466623333356134', 'path': '/dev/sde'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1534305402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1534305402',id=30,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-7pn4563d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:48:36Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=a1103e2e-7595-4cb7-89ff-dda2fa121ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "vif_mac": "fa:16:3e:f1:5f:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "vif_mac": "fa:16:3e:f1:5f:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'pci_devices' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:50:06 user nova-compute[72520]:   <uuid>a1103e2e-7595-4cb7-89ff-dda2fa121ad9</uuid>
Aug 02 23:50:06 user nova-compute[72520]:   <name>instance-0000001e</name>
Aug 02 23:50:06 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:50:06 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:50:06 user nova-compute[72520]:   <metadata>
Aug 02 23:50:06 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:50:06 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:50:06 user nova-compute[72520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1534305402</nova:name>
Aug 02 23:50:06 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:50:06</nova:creationTime>
Aug 02 23:50:06 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:50:06 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:50:06 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:50:06 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:50:06 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:50:06 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:50:06 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:50:06 user nova-compute[72520]:       <nova:owner>
Aug 02 23:50:06 user nova-compute[72520]:         <nova:user uuid="f3ecb56ac3554ee3b1ef658d9cdd3869">tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member</nova:user>
Aug 02 23:50:06 user nova-compute[72520]:         <nova:project uuid="542e5ab2d59245f58d357cf688e30a43">tempest-ServerBootFromVolumeStableRescueTest-1108272558</nova:project>
Aug 02 23:50:06 user nova-compute[72520]:       </nova:owner>
Aug 02 23:50:06 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:50:06 user nova-compute[72520]:       <nova:ports>
Aug 02 23:50:06 user nova-compute[72520]:         <nova:port uuid="51365aea-040d-4f66-bf48-ae79c5371e1b">
Aug 02 23:50:06 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 02 23:50:06 user nova-compute[72520]:         </nova:port>
Aug 02 23:50:06 user nova-compute[72520]:       </nova:ports>
Aug 02 23:50:06 user nova-compute[72520]:     </nova:instance>
Aug 02 23:50:06 user nova-compute[72520]:   </metadata>
Aug 02 23:50:06 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:50:06 user nova-compute[72520]:     <system>
Aug 02 23:50:06 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:50:06 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:50:06 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:50:06 user nova-compute[72520]:       <entry name="serial">a1103e2e-7595-4cb7-89ff-dda2fa121ad9</entry>
Aug 02 23:50:06 user nova-compute[72520]:       <entry name="uuid">a1103e2e-7595-4cb7-89ff-dda2fa121ad9</entry>
Aug 02 23:50:06 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:50:06 user nova-compute[72520]:     </system>
Aug 02 23:50:06 user nova-compute[72520]:   </sysinfo>
Aug 02 23:50:06 user nova-compute[72520]:   <os>
Aug 02 23:50:06 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:50:06 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:50:06 user nova-compute[72520]:   </os>
Aug 02 23:50:06 user nova-compute[72520]:   <features>
Aug 02 23:50:06 user nova-compute[72520]:     <acpi/>
Aug 02 23:50:06 user nova-compute[72520]:     <apic/>
Aug 02 23:50:06 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:50:06 user nova-compute[72520]:   </features>
Aug 02 23:50:06 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:50:06 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:50:06 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:50:06 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:50:06 user nova-compute[72520]:   </clock>
Aug 02 23:50:06 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:50:06 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:50:06 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:50:06 user nova-compute[72520]:   </cpu>
Aug 02 23:50:06 user nova-compute[72520]:   <devices>
Aug 02 23:50:06 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:50:06 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:50:06 user nova-compute[72520]:       <source dev="/dev/sde"/>
Aug 02 23:50:06 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:50:06 user nova-compute[72520]:       <serial>39e22842-5ac4-43df-bb63-d31dba32bf7d</serial>
Aug 02 23:50:06 user nova-compute[72520]:     </disk>
Aug 02 23:50:06 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:50:06 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:50:06 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.rescue"/>
Aug 02 23:50:06 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:50:06 user nova-compute[72520]:       <boot order="1"/>
Aug 02 23:50:06 user nova-compute[72520]:     </disk>
Aug 02 23:50:06 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:50:06 user nova-compute[72520]:       <mac address="fa:16:3e:f1:5f:6f"/>
Aug 02 23:50:06 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:50:06 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:50:06 user nova-compute[72520]:       <target dev="tap51365aea-04"/>
Aug 02 23:50:06 user nova-compute[72520]:     </interface>
Aug 02 23:50:06 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:50:06 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/console.log" append="off"/>
Aug 02 23:50:06 user nova-compute[72520]:     </serial>
Aug 02 23:50:06 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:50:06 user nova-compute[72520]:     <video>
Aug 02 23:50:06 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:50:06 user nova-compute[72520]:     </video>
Aug 02 23:50:06 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:50:06 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:50:06 user nova-compute[72520]:     </rng>
Aug 02 23:50:06 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:50:06 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:50:06 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:50:06 user nova-compute[72520]:     </memballoon>
Aug 02 23:50:06 user nova-compute[72520]:   </devices>
Aug 02 23:50:06 user nova-compute[72520]: </domain>
Aug 02 23:50:06 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:50:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance destroyed successfully.
Aug 02 23:50:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:50:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:50:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] No VIF found with MAC fa:16:3e:f1:5f:6f, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:50:07 user nova-compute[72520]: DEBUG nova.network.neutron [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updated VIF entry in instance network info cache for port cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:50:07 user nova-compute[72520]: DEBUG nova.network.neutron [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-995a7fbc-8155-42de-8542-04fd8a5faa8e req-df4210bf-f618-4ac2-8e91-886b54c55adf service nova] Releasing lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-84957b02-23d0-4e2d-9171-79e0d1c0d6d6 req-4b96b0a3-3c11-434e-b523-88c6db1b679c service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-84957b02-23d0-4e2d-9171-79e0d1c0d6d6 req-4b96b0a3-3c11-434e-b523-88c6db1b679c service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-84957b02-23d0-4e2d-9171-79e0d1c0d6d6 req-4b96b0a3-3c11-434e-b523-88c6db1b679c service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-84957b02-23d0-4e2d-9171-79e0d1c0d6d6 req-4b96b0a3-3c11-434e-b523-88c6db1b679c service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-84957b02-23d0-4e2d-9171-79e0d1c0d6d6 req-4b96b0a3-3c11-434e-b523-88c6db1b679c service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:08 user nova-compute[72520]: WARNING nova.compute.manager [req-84957b02-23d0-4e2d-9171-79e0d1c0d6d6 req-4b96b0a3-3c11-434e-b523-88c6db1b679c service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state active and task_state rescuing.
Aug 02 23:50:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-changed-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing instance network info cache due to event network-changed-cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] Acquiring lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] Acquired lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing network info cache for port cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updated VIF entry in instance network info cache for port cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-05f5b11b-7d93-4b9a-92d5-0f4d1c39bda9 req-adb2f522-a7c5-4fce-99b3-a3a08155c6c9 service nova] Releasing lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for a1103e2e-7595-4cb7-89ff-dda2fa121ad9 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020210.7202678, a1103e2e-7595-4cb7-89ff-dda2fa121ad9 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:50:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] VM Resumed (Lifecycle Event)
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-32a5e270-6f2a-4f03-a571-a9d7580c994d tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7d7bcc3-b35d-4a75-adc5-81708feb84a2 req-c0e8afda-a84e-4d51-a1e4-f6ddcd66b729 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d7bcc3-b35d-4a75-adc5-81708feb84a2 req-c0e8afda-a84e-4d51-a1e4-f6ddcd66b729 service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d7bcc3-b35d-4a75-adc5-81708feb84a2 req-c0e8afda-a84e-4d51-a1e4-f6ddcd66b729 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d7d7bcc3-b35d-4a75-adc5-81708feb84a2 req-c0e8afda-a84e-4d51-a1e4-f6ddcd66b729 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-d7d7bcc3-b35d-4a75-adc5-81708feb84a2 req-c0e8afda-a84e-4d51-a1e4-f6ddcd66b729 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:10 user nova-compute[72520]: WARNING nova.compute.manager [req-d7d7bcc3-b35d-4a75-adc5-81708feb84a2 req-c0e8afda-a84e-4d51-a1e4-f6ddcd66b729 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state active and task_state rescuing.
Aug 02 23:50:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020210.7221272, a1103e2e-7595-4cb7-89ff-dda2fa121ad9 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:50:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] VM Started (Lifecycle Event)
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:50:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:50:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:13 user nova-compute[72520]: INFO nova.compute.manager [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Rebooting instance
Aug 02 23:50:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquired lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Releasing lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:50:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-779054a0-b405-4c83-8407-68afe6556502 req-848207d7-f7f5-4c69-ad25-3d3444bd95ff service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-unplugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-779054a0-b405-4c83-8407-68afe6556502 req-848207d7-f7f5-4c69-ad25-3d3444bd95ff service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-779054a0-b405-4c83-8407-68afe6556502 req-848207d7-f7f5-4c69-ad25-3d3444bd95ff service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-779054a0-b405-4c83-8407-68afe6556502 req-848207d7-f7f5-4c69-ad25-3d3444bd95ff service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-779054a0-b405-4c83-8407-68afe6556502 req-848207d7-f7f5-4c69-ad25-3d3444bd95ff service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-unplugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:14 user nova-compute[72520]: WARNING nova.compute.manager [req-779054a0-b405-4c83-8407-68afe6556502 req-848207d7-f7f5-4c69-ad25-3d3444bd95ff service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received unexpected event network-vif-unplugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with vm_state active and task_state reboot_started_hard.
Aug 02 23:50:14 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance destroyed successfully.
Aug 02 23:50:14 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'resources' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646579882',display_name='tempest-TestMinimumBasicScenario-server-646579882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646579882',id=29,image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm+lQlr4C68vf2L3WNELyzZM6+9+z5v54RWQE//K+Rt5Dxcs7aOI+QVJsGj4ECNsYlJs3O6wqYSsQONvn5Xe0sMITk9hqdLPEnYoqMO0YQVGzu95vqn/DwHV3JOqzzajg==',key_name='tempest-TestMinimumBasicScenario-469330076',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-08ty7096',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:50:14Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=06f97de2-7a1f-4fc4-92cb-27e08df31263,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_vif [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb421f82-bf, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:14 user nova-compute[72520]: INFO os_vif [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf')
Aug 02 23:50:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgJQbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:50:14 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ecd076-8df3-4341-88f8-38117219605d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a90b97f-88b8-4540-b73e-fe02f38db98e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:14 user nova-compute[72520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:14 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4409360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0'): ({'sdf'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Removing single pathed devices sdf {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcbfc4e-869a-427b-aee2-d7dcc16d408d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[94acd14e-7931-4549-9132-d92302634400]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flushing IO for device /dev/sdf {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de0cd1-c16f-4cb3-b17b-4ac736a8944d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2cf442-22b9-41fc-a56f-f40f6e04b032]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] SCSI volumes sdf have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[357ef8b3-44bd-4b89-ab3f-5e4779eba014]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a799911-7d7b-472a-8ba4-8ecc5435227d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]
Aug 02 23:50:15 user nova-compute[72520]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.
Aug 02 23:50:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d479fcf-3b02-41c7-884f-1f0457558cc9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== disconnect_volume: return (320ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Start _get_guest_xml network_info=[{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=240d88aa-9816-4486-bc0b-54184b80e54e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '240d88aa-9816-4486-bc0b-54184b80e54e'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgJQbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '06f97de2-7a1f-4fc4-92cb-27e08df31263', 'attached_at': '', 'detached_at': '', 'volume_id': '8c81da47-89de-48e1-9591-89e32de627e0', 'serial': '8c81da47-89de-48e1-9591-89e32de627e0'}, 'attachment_id': '3660a6de-2bbd-4c8c-bac4-e62fbf820532', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:50:15 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:50:15 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=240d88aa-9816-4486-bc0b-54184b80e54e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgJQbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:50:15 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:50:15 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:50:15 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c74b5d-df93-4359-9d18-8eb3c1d48f25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:50:15 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8a151-c1ce-4e77-a641-d557a0348f66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0] added
Aug 02 23:50:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed54db4b-7c38-43d2-b6b5-0a2eb54e8610]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c7f1d6-4d8e-4d6b-9a7d-160c65df342b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liSgJQbD {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liSgJQbD" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7cec03-5f6b-4eba-935c-6b7d4a385431]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'liSgJQbD'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34824ea6-10c4-4905-a090-1a48d5c6cd2c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eacebbb-dfe1-4695-8d3a-6fc558bf0aa0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee456db-9266-48c0-bdee-4ec880a1b27c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]
Aug 02 23:50:15 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.
Aug 02 23:50:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf9df00-2bf2-4340-81a4-e9da2f2928d5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd4e148-4385-43a7-9199-9191c1182ac3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:15 user nova-compute[72520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c56f3c-462f-4217-bd5b-7515f749018a]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:50:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgJQbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-dfdd8259-d99a-4224-9398-eff08ee72381 req-8e89c318-ca9b-4997-98cf-7d76f3a4e06c service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-dfdd8259-d99a-4224-9398-eff08ee72381 req-8e89c318-ca9b-4997-98cf-7d76f3a4e06c service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-dfdd8259-d99a-4224-9398-eff08ee72381 req-8e89c318-ca9b-4997-98cf-7d76f3a4e06c service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-dfdd8259-d99a-4224-9398-eff08ee72381 req-8e89c318-ca9b-4997-98cf-7d76f3a4e06c service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-dfdd8259-d99a-4224-9398-eff08ee72381 req-8e89c318-ca9b-4997-98cf-7d76f3a4e06c service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:16 user nova-compute[72520]: WARNING nova.compute.manager [req-dfdd8259-d99a-4224-9398-eff08ee72381 req-8e89c318-ca9b-4997-98cf-7d76f3a4e06c service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received unexpected event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with vm_state active and task_state reboot_started_hard.
Aug 02 23:50:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23564633438653363', 'path': '/dev/sdf'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564633438653363', 'path': '/dev/sdf'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646579882',display_name='tempest-TestMinimumBasicScenario-server-646579882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646579882',id=29,image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm+lQlr4C68vf2L3WNELyzZM6+9+z5v54RWQE//K+Rt5Dxcs7aOI+QVJsGj4ECNsYlJs3O6wqYSsQONvn5Xe0sMITk9hqdLPEnYoqMO0YQVGzu95vqn/DwHV3JOqzzajg==',key_name='tempest-TestMinimumBasicScenario-469330076',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-08ty7096',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:50:14Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=06f97de2-7a1f-4fc4-92cb-27e08df31263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'pci_devices' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:50:16 user nova-compute[72520]:   <uuid>06f97de2-7a1f-4fc4-92cb-27e08df31263</uuid>
Aug 02 23:50:16 user nova-compute[72520]:   <name>instance-0000001d</name>
Aug 02 23:50:16 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:50:16 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:50:16 user nova-compute[72520]:   <metadata>
Aug 02 23:50:16 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:50:16 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:50:16 user nova-compute[72520]:       <nova:name>tempest-TestMinimumBasicScenario-server-646579882</nova:name>
Aug 02 23:50:16 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:50:15</nova:creationTime>
Aug 02 23:50:16 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:50:16 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:50:16 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:50:16 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:50:16 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:50:16 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:50:16 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:50:16 user nova-compute[72520]:       <nova:owner>
Aug 02 23:50:16 user nova-compute[72520]:         <nova:user uuid="c7b27a450e444b308fc54577d724cc7a">tempest-TestMinimumBasicScenario-951726597-project-member</nova:user>
Aug 02 23:50:16 user nova-compute[72520]:         <nova:project uuid="4b274c7dd5374d739bd700643b0bf63e">tempest-TestMinimumBasicScenario-951726597</nova:project>
Aug 02 23:50:16 user nova-compute[72520]:       </nova:owner>
Aug 02 23:50:16 user nova-compute[72520]:       <nova:root type="image" uuid="240d88aa-9816-4486-bc0b-54184b80e54e"/>
Aug 02 23:50:16 user nova-compute[72520]:       <nova:ports>
Aug 02 23:50:16 user nova-compute[72520]:         <nova:port uuid="cb421f82-bf44-46ba-98c0-83c543190284">
Aug 02 23:50:16 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:50:16 user nova-compute[72520]:         </nova:port>
Aug 02 23:50:16 user nova-compute[72520]:       </nova:ports>
Aug 02 23:50:16 user nova-compute[72520]:     </nova:instance>
Aug 02 23:50:16 user nova-compute[72520]:   </metadata>
Aug 02 23:50:16 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:50:16 user nova-compute[72520]:     <system>
Aug 02 23:50:16 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:50:16 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:50:16 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:50:16 user nova-compute[72520]:       <entry name="serial">06f97de2-7a1f-4fc4-92cb-27e08df31263</entry>
Aug 02 23:50:16 user nova-compute[72520]:       <entry name="uuid">06f97de2-7a1f-4fc4-92cb-27e08df31263</entry>
Aug 02 23:50:16 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:50:16 user nova-compute[72520]:     </system>
Aug 02 23:50:16 user nova-compute[72520]:   </sysinfo>
Aug 02 23:50:16 user nova-compute[72520]:   <os>
Aug 02 23:50:16 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:50:16 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:50:16 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:50:16 user nova-compute[72520]:   </os>
Aug 02 23:50:16 user nova-compute[72520]:   <features>
Aug 02 23:50:16 user nova-compute[72520]:     <acpi/>
Aug 02 23:50:16 user nova-compute[72520]:     <apic/>
Aug 02 23:50:16 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:50:16 user nova-compute[72520]:   </features>
Aug 02 23:50:16 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:50:16 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:50:16 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:50:16 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:50:16 user nova-compute[72520]:   </clock>
Aug 02 23:50:16 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:50:16 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:50:16 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:50:16 user nova-compute[72520]:   </cpu>
Aug 02 23:50:16 user nova-compute[72520]:   <devices>
Aug 02 23:50:16 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:50:16 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:50:16 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk"/>
Aug 02 23:50:16 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:50:16 user nova-compute[72520]:     </disk>
Aug 02 23:50:16 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:50:16 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:50:16 user nova-compute[72520]:       <source dev="/dev/sdf"/>
Aug 02 23:50:16 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 02 23:50:16 user nova-compute[72520]:       <serial>8c81da47-89de-48e1-9591-89e32de627e0</serial>
Aug 02 23:50:16 user nova-compute[72520]:     </disk>
Aug 02 23:50:16 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:50:16 user nova-compute[72520]:       <mac address="fa:16:3e:f9:fe:42"/>
Aug 02 23:50:16 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:50:16 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:50:16 user nova-compute[72520]:       <target dev="tapcb421f82-bf"/>
Aug 02 23:50:16 user nova-compute[72520]:     </interface>
Aug 02 23:50:16 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:50:16 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/console.log" append="off"/>
Aug 02 23:50:16 user nova-compute[72520]:     </serial>
Aug 02 23:50:16 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:50:16 user nova-compute[72520]:     <video>
Aug 02 23:50:16 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:50:16 user nova-compute[72520]:     </video>
Aug 02 23:50:16 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:50:16 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:50:16 user nova-compute[72520]:     </rng>
Aug 02 23:50:16 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:50:16 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:50:16 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:50:16 user nova-compute[72520]:     </memballoon>
Aug 02 23:50:16 user nova-compute[72520]:   </devices>
Aug 02 23:50:16 user nova-compute[72520]: </domain>
Aug 02 23:50:16 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'trusted_certs' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Cannot resize image /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'migration_context' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646579882',display_name='tempest-TestMinimumBasicScenario-server-646579882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646579882',id=29,image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm+lQlr4C68vf2L3WNELyzZM6+9+z5v54RWQE//K+Rt5Dxcs7aOI+QVJsGj4ECNsYlJs3O6wqYSsQONvn5Xe0sMITk9hqdLPEnYoqMO0YQVGzu95vqn/DwHV3JOqzzajg==',key_name='tempest-TestMinimumBasicScenario-469330076',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-08ty7096',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:50:14Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=06f97de2-7a1f-4fc4-92cb-27e08df31263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG os_vif [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb421f82-bf, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb421f82-bf, col_values=(('external_ids', {'iface-id': 'cb421f82-bf44-46ba-98c0-83c543190284', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:fe:42', 'vm-uuid': '06f97de2-7a1f-4fc4-92cb-27e08df31263'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:50:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:17 user nova-compute[72520]: INFO os_vif [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf')
Aug 02 23:50:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:18 user nova-compute[72520]: DEBUG nova.compute.manager [req-93f95fac-931a-4b5b-9d7c-4f2853bf6fa3 req-71cfa637-a3b0-42fe-ad30-f47ac4c1eda2 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-93f95fac-931a-4b5b-9d7c-4f2853bf6fa3 req-71cfa637-a3b0-42fe-ad30-f47ac4c1eda2 service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-93f95fac-931a-4b5b-9d7c-4f2853bf6fa3 req-71cfa637-a3b0-42fe-ad30-f47ac4c1eda2 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-93f95fac-931a-4b5b-9d7c-4f2853bf6fa3 req-71cfa637-a3b0-42fe-ad30-f47ac4c1eda2 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:18 user nova-compute[72520]: DEBUG nova.compute.manager [req-93f95fac-931a-4b5b-9d7c-4f2853bf6fa3 req-71cfa637-a3b0-42fe-ad30-f47ac4c1eda2 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:18 user nova-compute[72520]: WARNING nova.compute.manager [req-93f95fac-931a-4b5b-9d7c-4f2853bf6fa3 req-71cfa637-a3b0-42fe-ad30-f47ac4c1eda2 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received unexpected event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with vm_state active and task_state reboot_started_hard.
Aug 02 23:50:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for 06f97de2-7a1f-4fc4-92cb-27e08df31263 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020220.7593696, 06f97de2-7a1f-4fc4-92cb-27e08df31263 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:50:20 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] VM Resumed (Lifecycle Event)
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:50:20 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance rebooted successfully.
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:50:20 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020220.7663598, 06f97de2-7a1f-4fc4-92cb-27e08df31263 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:50:20 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] VM Started (Lifecycle Event)
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-17e3ada5-ab8d-4c40-b68b-9dd9534d3505 req-650711df-9a52-435b-8a24-2a0b5336bc59 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17e3ada5-ab8d-4c40-b68b-9dd9534d3505 req-650711df-9a52-435b-8a24-2a0b5336bc59 service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17e3ada5-ab8d-4c40-b68b-9dd9534d3505 req-650711df-9a52-435b-8a24-2a0b5336bc59 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17e3ada5-ab8d-4c40-b68b-9dd9534d3505 req-650711df-9a52-435b-8a24-2a0b5336bc59 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [req-17e3ada5-ab8d-4c40-b68b-9dd9534d3505 req-650711df-9a52-435b-8a24-2a0b5336bc59 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:20 user nova-compute[72520]: WARNING nova.compute.manager [req-17e3ada5-ab8d-4c40-b68b-9dd9534d3505 req-650711df-9a52-435b-8a24-2a0b5336bc59 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received unexpected event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with vm_state active and task_state reboot_started_hard.
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:50:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:50:20 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 02 23:50:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6b8c2486-6bee-4701-a774-c509404bf24d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.601s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing instance network info cache due to event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:50:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] Acquiring lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:50:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] Acquired lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:50:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:52 user nova-compute[72520]: INFO nova.compute.manager [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Terminating instance
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.network.neutron [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updated VIF entry in instance network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.network.neutron [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e887b3bf-4de1-403f-9c6a-568668172941 req-8eb4fa6c-a83f-4800-8d29-a0c475d704b4 service nova] Releasing lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:52 user nova-compute[72520]: INFO nova.compute.manager [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Detaching volume 53c30d2f-3941-432d-b3f6-27c6f63ef7d8
Aug 02 23:50:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:52 user nova-compute[72520]: INFO nova.virt.block_device [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Attempting to driver detach volume 53c30d2f-3941-432d-b3f6-27c6f63ef7d8 from mountpoint /dev/vdb
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Attempting to detach device vdb from instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:50:52 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:50:52 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:50:52 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:50:52 user nova-compute[72520]:   <serial>53c30d2f-3941-432d-b3f6-27c6f63ef7d8</serial>
Aug 02 23:50:52 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:50:52 user nova-compute[72520]: </disk>
Aug 02 23:50:52 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:50:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully detached device vdb from instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 from the persistent domain config.
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:50:52 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:50:52 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:50:52 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:50:52 user nova-compute[72520]:   <serial>53c30d2f-3941-432d-b3f6-27c6f63ef7d8</serial>
Aug 02 23:50:52 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:50:52 user nova-compute[72520]: </disk>
Aug 02 23:50:52 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020252.9604251, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:50:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully detached device vdb from instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 from the live domain config.
Aug 02 23:50:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCFfmLMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:50:52 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:50:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:52 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf8cce-96bf-42eb-8b68-f017d02dda8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aaad98-1273-4d45-9ef0-326f0d43efbb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:50:53 user nova-compute[72520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:50:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce42984c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae246ee-0532-42f0-a386-5d53c1c9aff4]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83808089-9232-48d3-bef7-f82b3516bf6e]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0497ac0-2b22-40c4-9e00-032618af0ca1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1b4f9-e3b0-413b-89fa-054ab21c6b8d]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cd0e60-d19c-4766-8b23-3d7b715195e8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be9bc9-e3ec-4aa7-98a8-1332b471bf9b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260]
Aug 02 23:50:53 user nova-compute[72520]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8, portal: 172.16.0.220,3260] successful.
Aug 02 23:50:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c30d2f-3941-432d-b3f6-27c6f63ef7d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdc0c2d-6473-4852-9eff-32596194d2ee]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] <== disconnect_volume: return (297ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:50:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Instance destroyed successfully.
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lazy-loading 'resources' on Instance uuid b6a28b99-39c3-4252-b256-c7233ba7eb7e {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1158749578',display_name='tempest-VolumesActionsTest-instance-1158749578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1158749578',id=31,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4378f14a806b49909b771be46b36fa26',ramdisk_id='',reservation_id='r-lcysk9i3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1758836648',owner_user_name='tempest-VolumesActionsTest-1758836648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:49:00Z,user_data=None,user_id='79582888cd7f4b298477f7b894fb2271',uuid=b6a28b99-39c3-4252-b256-c7233ba7eb7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Converting VIF {"id": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "address": "fa:16:3e:b5:a9:ba", "network": {"id": "386e2be2-0690-45fe-be1e-c03503916e4d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-941878345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4378f14a806b49909b771be46b36fa26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dd99830-dc", "ovs_interfaceid": "8dd99830-dc1b-40e1-8208-e2a2e4ad318d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a9:ba,bridge_name='br-int',has_traffic_filtering=True,id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d,network=Network(386e2be2-0690-45fe-be1e-c03503916e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dd99830-dc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG os_vif [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a9:ba,bridge_name='br-int',has_traffic_filtering=True,id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d,network=Network(386e2be2-0690-45fe-be1e-c03503916e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dd99830-dc') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8dd99830-dc, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:50:53 user nova-compute[72520]: INFO os_vif [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a9:ba,bridge_name='br-int',has_traffic_filtering=True,id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d,network=Network(386e2be2-0690-45fe-be1e-c03503916e4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dd99830-dc')
Aug 02 23:50:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Deleting instance files /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e_del
Aug 02 23:50:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Deletion of /opt/stack/data/nova/instances/b6a28b99-39c3-4252-b256-c7233ba7eb7e_del complete
Aug 02 23:50:53 user nova-compute[72520]: INFO nova.compute.manager [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing instance network info cache due to event network-changed-005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Acquiring lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Acquired lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Refreshing network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:53 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:54 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Took 0.59 seconds to deallocate network for instance.
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-995eb6d8-870a-44eb-8a7e-d19835eb010a req-dfb96354-a4dd-4e84-9a0f-db0bc5b298e6 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received event network-vif-deleted-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:54 user nova-compute[72520]: INFO nova.compute.manager [req-995eb6d8-870a-44eb-8a7e-d19835eb010a req-dfb96354-a4dd-4e84-9a0f-db0bc5b298e6 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Neutron deleted interface 8dd99830-dc1b-40e1-8208-e2a2e4ad318d; detaching it from the instance and deleting it from the info cache
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-995eb6d8-870a-44eb-8a7e-d19835eb010a req-dfb96354-a4dd-4e84-9a0f-db0bc5b298e6 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-995eb6d8-870a-44eb-8a7e-d19835eb010a req-dfb96354-a4dd-4e84-9a0f-db0bc5b298e6 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Detach interface failed, port_id=8dd99830-dc1b-40e1-8208-e2a2e4ad318d, reason: Instance b6a28b99-39c3-4252-b256-c7233ba7eb7e could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'flavor' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-33963b36-34f0-43d7-954f-33857df2686f tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.675s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updated VIF entry in instance network info cache for port 005e5e35-c836-4c41-99c6-e3233614ed8a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [{"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Releasing lock "refresh_cache-e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received event network-vif-unplugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Acquiring lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] No waiting events found dispatching network-vif-unplugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received event network-vif-unplugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received event network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Acquiring lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] No waiting events found dispatching network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:50:54 user nova-compute[72520]: WARNING nova.compute.manager [req-9094cb3f-83cc-4ad9-9c11-0b0aa4446a8a req-6f7fb1d6-d562-4452-a581-6e1be263eee5 service nova] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Received unexpected event network-vif-plugged-8dd99830-dc1b-40e1-8208-e2a2e4ad318d for instance with vm_state active and task_state deleting.
Aug 02 23:50:54 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Deleted allocations for instance b6a28b99-39c3-4252-b256-c7233ba7eb7e
Aug 02 23:50:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f635739d-13c5-43f0-9ffa-cda9d0aa3ebe tempest-VolumesActionsTest-1758836648 tempest-VolumesActionsTest-1758836648-project-member] Lock "b6a28b99-39c3-4252-b256-c7233ba7eb7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updating instance_info_cache with network_info: [{"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:50:55 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:50:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:50:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:51:02 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:51:02 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7612MB free_disk=25.124855041503906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Applying migration context for instance 982bd91f-8b1a-41b2-ad23-3d31136de392 as it has an incoming, in-progress migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d. Migration status is finished {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 02 23:51:02 user nova-compute[72520]: INFO nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating resource usage from migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a1103e2e-7595-4cb7-89ff-dda2fa121ad9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 982bd91f-8b1a-41b2-ad23-3d31136de392 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:51:02 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:51:03 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:51:03 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:51:03 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:51:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:51:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Going to confirm migration 1 {{(pid=72520) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquired lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'info_cache' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [{"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Releasing lock "refresh_cache-982bd91f-8b1a-41b2-ad23-3d31136de392" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'migration_context' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:07 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:51:07 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:51:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.420s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:07 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Deleted allocation for migration 53b57be9-79b1-44a0-899e-cd7d8f7f382d
Aug 02 23:51:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-85786b7d-d371-4d66-abdb-54c6df9bb186 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.474s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:08 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020253.3153276, b6a28b99-39c3-4252-b256-c7233ba7eb7e => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:51:08 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] VM Stopped (Lifecycle Event)
Aug 02 23:51:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec50a994-62fb-44d9-8d99-2b324bb60127 None None] [instance: b6a28b99-39c3-4252-b256-c7233ba7eb7e] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:51:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:51:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:51:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:51:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:51:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:42 user nova-compute[72520]: INFO nova.compute.manager [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Terminating instance
Aug 02 23:51:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:51:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-96635207-168f-4743-8546-ecce9adc6a2b req-d24f6da0-4f5a-43da-8a65-5ee020237003 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96635207-168f-4743-8546-ecce9adc6a2b req-d24f6da0-4f5a-43da-8a65-5ee020237003 service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96635207-168f-4743-8546-ecce9adc6a2b req-d24f6da0-4f5a-43da-8a65-5ee020237003 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96635207-168f-4743-8546-ecce9adc6a2b req-d24f6da0-4f5a-43da-8a65-5ee020237003 service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-96635207-168f-4743-8546-ecce9adc6a2b req-d24f6da0-4f5a-43da-8a65-5ee020237003 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-96635207-168f-4743-8546-ecce9adc6a2b req-d24f6da0-4f5a-43da-8a65-5ee020237003 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-unplugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Instance destroyed successfully.
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'resources' on Instance uuid e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-405470045',display_name='tempest-ServerRescueNegativeTestJSON-server-405470045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-405470045',id=26,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPmJC3+jJREMbo4vqNbPCJGeywe1JSNQOWoUCi6p5IcE2cNco4Oup4a9sV89yRuXDMgmdqQUXimUmNv/DaDPrAMItkd3457w7kS79ih+4k6SjV+YEljCzGCexL9EtAIhw==',key_name='tempest-keypair-420863145',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-elxyxg0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d02269696a0d47738d8daa53d44b3b70',uuid=e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "005e5e35-c836-4c41-99c6-e3233614ed8a", "address": "fa:16:3e:42:5f:c4", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap005e5e35-c8", "ovs_interfaceid": "005e5e35-c836-4c41-99c6-e3233614ed8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG os_vif [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap005e5e35-c8, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:51:43 user nova-compute[72520]: INFO os_vif [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:5f:c4,bridge_name='br-int',has_traffic_filtering=True,id=005e5e35-c836-4c41-99c6-e3233614ed8a,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap005e5e35-c8')
Aug 02 23:51:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Deleting instance files /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8_del
Aug 02 23:51:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Deletion of /opt/stack/data/nova/instances/e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8_del complete
Aug 02 23:51:43 user nova-compute[72520]: INFO nova.compute.manager [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 02 23:51:43 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:51:43 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:51:44 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:51:44 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Took 1.34 seconds to deallocate network for instance.
Aug 02 23:51:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-2e6c3e53-8391-46b8-9740-cd845af25ad6 req-254f6ef8-1ca6-44b8-8217-0f9279041b79 service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-deleted-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-c4d7cde3-76e1-488e-a98e-d972a05878ea req-21abd1a3-5858-4050-8487-914ba3c3ae5f service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4d7cde3-76e1-488e-a98e-d972a05878ea req-21abd1a3-5858-4050-8487-914ba3c3ae5f service nova] Acquiring lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4d7cde3-76e1-488e-a98e-d972a05878ea req-21abd1a3-5858-4050-8487-914ba3c3ae5f service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4d7cde3-76e1-488e-a98e-d972a05878ea req-21abd1a3-5858-4050-8487-914ba3c3ae5f service nova] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-c4d7cde3-76e1-488e-a98e-d972a05878ea req-21abd1a3-5858-4050-8487-914ba3c3ae5f service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] No waiting events found dispatching network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:51:45 user nova-compute[72520]: WARNING nova.compute.manager [req-c4d7cde3-76e1-488e-a98e-d972a05878ea req-21abd1a3-5858-4050-8487-914ba3c3ae5f service nova] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Received unexpected event network-vif-plugged-005e5e35-c836-4c41-99c6-e3233614ed8a for instance with vm_state deleted and task_state None.
Aug 02 23:51:45 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:51:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:45 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Deleted allocations for instance e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8
Aug 02 23:51:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ef54a9a6-b14c-4388-afb2-22a82ed97920 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:51:53 user nova-compute[72520]: INFO nova.compute.manager [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Unrescuing
Aug 02 23:51:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:51:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquired lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:51:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:51:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 02 23:51:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updating instance_info_cache with network_info: [{"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:51:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Releasing lock "refresh_cache-a1103e2e-7595-4cb7-89ff-dda2fa121ad9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:51:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'flavor' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:51:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2218e76-a353-40f6-b136-b6ad0b499d4e req-f31163d5-ae34-4da4-a33b-1d4712421233 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:51:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2218e76-a353-40f6-b136-b6ad0b499d4e req-f31163d5-ae34-4da4-a33b-1d4712421233 service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2218e76-a353-40f6-b136-b6ad0b499d4e req-f31163d5-ae34-4da4-a33b-1d4712421233 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2218e76-a353-40f6-b136-b6ad0b499d4e req-f31163d5-ae34-4da4-a33b-1d4712421233 service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2218e76-a353-40f6-b136-b6ad0b499d4e req-f31163d5-ae34-4da4-a33b-1d4712421233 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:51:55 user nova-compute[72520]: WARNING nova.compute.manager [req-c2218e76-a353-40f6-b136-b6ad0b499d4e req-f31163d5-ae34-4da4-a33b-1d4712421233 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:51:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:55 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:55 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance destroyed successfully.
Aug 02 23:51:56 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:51:57 user nova-compute[72520]: WARNING nova.compute.manager [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:51:57 user nova-compute[72520]: WARNING nova.compute.manager [req-e98c9756-3c29-48ab-a987-3163a1e073fa req-468ff089-c008-472b-84ad-2422ccd1f12d service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state rescued and task_state unrescuing.
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [{"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-6ca3c320-bf1c-43b5-973c-4d73b22487ac" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 02 23:51:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 02 23:51:58 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020303.5054398, e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:51:58 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] VM Stopped (Lifecycle Event)
Aug 02 23:51:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b5c63cff-b625-42f6-92bc-642cf0658daa None None] [instance: e9b54f8f-3fc3-4a5d-8b01-f6d7d349baa8] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:51:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for a1103e2e-7595-4cb7-89ff-dda2fa121ad9 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:51:58 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020318.9937131, a1103e2e-7595-4cb7-89ff-dda2fa121ad9 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:51:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] VM Resumed (Lifecycle Event)
Aug 02 23:51:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e3d7863d-c58f-4dc0-914d-2c869c40ecee tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:51:59 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 02 23:51:59 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020318.9952016, a1103e2e-7595-4cb7-89ff-dda2fa121ad9 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:51:59 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] VM Started (Lifecycle Event)
Aug 02 23:51:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-6b269473-39e5-47c2-a5ad-5c320fa2db7b req-ef4b8df8-7f45-4da3-9e0f-4ce1b3b4e90b service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b269473-39e5-47c2-a5ad-5c320fa2db7b req-ef4b8df8-7f45-4da3-9e0f-4ce1b3b4e90b service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b269473-39e5-47c2-a5ad-5c320fa2db7b req-ef4b8df8-7f45-4da3-9e0f-4ce1b3b4e90b service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6b269473-39e5-47c2-a5ad-5c320fa2db7b req-ef4b8df8-7f45-4da3-9e0f-4ce1b3b4e90b service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:51:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-6b269473-39e5-47c2-a5ad-5c320fa2db7b req-ef4b8df8-7f45-4da3-9e0f-4ce1b3b4e90b service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:51:59 user nova-compute[72520]: WARNING nova.compute.manager [req-6b269473-39e5-47c2-a5ad-5c320fa2db7b req-ef4b8df8-7f45-4da3-9e0f-4ce1b3b4e90b service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state active and task_state None.
Aug 02 23:51:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:01 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:04 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:52:04 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=7952MB free_disk=25.15228271484375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 23931909-81f4-44fb-b936-10a27c16febb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a1103e2e-7595-4cb7-89ff-dda2fa121ad9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 982bd91f-8b1a-41b2-ad23-3d31136de392 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-changed-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:52:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing instance network info cache due to event network-changed-cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:52:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] Acquiring lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:52:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] Acquired lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:52:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing network info cache for port cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:52:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updated VIF entry in instance network info cache for port cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ac36384-ccb1-49ee-a60f-4d517a791787 req-1fd9aa84-45cd-4348-98de-e1a98a56fa37 service nova] Releasing lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-changed-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing instance network info cache due to event network-changed-cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] Acquiring lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] Acquired lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Refreshing network info cache for port cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:06 user nova-compute[72520]: INFO nova.compute.manager [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Detaching volume 8c81da47-89de-48e1-9591-89e32de627e0
Aug 02 23:52:06 user nova-compute[72520]: INFO nova.virt.block_device [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Attempting to driver detach volume 8c81da47-89de-48e1-9591-89e32de627e0 from mountpoint /dev/vdb
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Attempting to detach device vdb from instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:52:06 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:52:06 user nova-compute[72520]:   <source dev="/dev/sdf"/>
Aug 02 23:52:06 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:52:06 user nova-compute[72520]:   <serial>8c81da47-89de-48e1-9591-89e32de627e0</serial>
Aug 02 23:52:06 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 02 23:52:06 user nova-compute[72520]: </disk>
Aug 02 23:52:06 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:52:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully detached device vdb from instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 from the persistent domain config.
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:52:06 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:52:06 user nova-compute[72520]:   <source dev="/dev/sdf"/>
Aug 02 23:52:06 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:52:06 user nova-compute[72520]:   <serial>8c81da47-89de-48e1-9591-89e32de627e0</serial>
Aug 02 23:52:06 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 02 23:52:06 user nova-compute[72520]: </disk>
Aug 02 23:52:06 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updated VIF entry in instance network info cache for port cb421f82-bf44-46ba-98c0-83c543190284. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [{"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:52:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-56996b10-1169-4120-83d8-3399d22a8a17 req-56e77265-3c81-4e49-bccd-507f4e850ae1 service nova] Releasing lock "refresh_cache-06f97de2-7a1f-4fc4-92cb-27e08df31263" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020327.2656004, 06f97de2-7a1f-4fc4-92cb-27e08df31263 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:52:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully detached device vdb from instance 06f97de2-7a1f-4fc4-92cb-27e08df31263 from the live domain config.
Aug 02 23:52:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liSgJQbD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:52:07 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5027c58b-e89b-4f25-ae3f-bbbcb0d60b11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c57fb89-b5df-426e-8b20-f6711604e45c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:52:07 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:52:07 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:52:07 user nova-compute[72520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:52:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:52:07 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:52:07 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:52:07 user nova-compute[72520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 (non-flash)
Aug 02 23:52:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc25fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0'): ({'sdf'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Removing single pathed devices sdf {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34994578-a7a0-4cda-b755-7b62ef84d8f5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d855fa6-158d-4fd8-b237-766511d853ba]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flushing IO for device /dev/sdf {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c369f70e-be4f-4249-a32b-153794ff75a9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5bddf4-1c06-4971-9ea5-ae169fee3e9a]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] SCSI volumes sdf have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ccf713-bfdd-49e9-8a00-a5a5ef27d4c7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb84dca0-a9e3-4f68-9ae9-d788b085e0cd]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260]
Aug 02 23:52:07 user nova-compute[72520]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0, portal: 172.16.0.220,3260] successful.
Aug 02 23:52:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c81da47-89de-48e1-9591-89e32de627e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd1e5a3-4e8c-48da-85a4-4bc3d3abdae9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== disconnect_volume: return (314ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:52:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:52:08 user nova-compute[72520]: DEBUG nova.objects.instance [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'flavor' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:52:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e980fcf4-88a0-45f1-a4f8-12fb18b9077c tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.908s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "23931909-81f4-44fb-b936-10a27c16febb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:43 user nova-compute[72520]: INFO nova.compute.manager [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Terminating instance
Aug 02 23:52:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-e55b9e05-b96c-4d1e-8765-621052d1f635 req-daf79896-f8aa-4c06-9f55-e66ed54cdcef service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-unplugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e55b9e05-b96c-4d1e-8765-621052d1f635 req-daf79896-f8aa-4c06-9f55-e66ed54cdcef service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e55b9e05-b96c-4d1e-8765-621052d1f635 req-daf79896-f8aa-4c06-9f55-e66ed54cdcef service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e55b9e05-b96c-4d1e-8765-621052d1f635 req-daf79896-f8aa-4c06-9f55-e66ed54cdcef service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-e55b9e05-b96c-4d1e-8765-621052d1f635 req-daf79896-f8aa-4c06-9f55-e66ed54cdcef service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-unplugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-e55b9e05-b96c-4d1e-8765-621052d1f635 req-daf79896-f8aa-4c06-9f55-e66ed54cdcef service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-unplugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:52:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Instance destroyed successfully.
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'resources' on Instance uuid 23931909-81f4-44fb-b936-10a27c16febb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1365006288',display_name='tempest-ServerRescueNegativeTestJSON-server-1365006288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1365006288',id=17,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-xocj6gh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:38:28Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=23931909-81f4-44fb-b936-10a27c16febb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "address": "fa:16:3e:a2:15:80", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d8d42-40", "ovs_interfaceid": "1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG os_vif [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a9d8d42-40, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:44 user nova-compute[72520]: INFO os_vif [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:15:80,bridge_name='br-int',has_traffic_filtering=True,id=1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d8d42-40')
Aug 02 23:52:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Deleting instance files /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb_del
Aug 02 23:52:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Deletion of /opt/stack/data/nova/instances/23931909-81f4-44fb-b936-10a27c16febb_del complete
Aug 02 23:52:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 02 23:52:44 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:52:44 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:52:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:45 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:52:45 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Took 0.46 seconds to deallocate network for instance.
Aug 02 23:52:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:45 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:52:45 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:52:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:45 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Deleted allocations for instance 23931909-81f4-44fb-b936-10a27c16febb
Aug 02 23:52:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d39efc82-8bb3-4e4f-8e63-34ac1080a985 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "23931909-81f4-44fb-b936-10a27c16febb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-de1e6999-ea3f-49ae-a7ed-02cc42e652c9 req-59486ca4-559d-4d43-985b-f78acc0ff2ae service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:52:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de1e6999-ea3f-49ae-a7ed-02cc42e652c9 req-59486ca4-559d-4d43-985b-f78acc0ff2ae service nova] Acquiring lock "23931909-81f4-44fb-b936-10a27c16febb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:52:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de1e6999-ea3f-49ae-a7ed-02cc42e652c9 req-59486ca4-559d-4d43-985b-f78acc0ff2ae service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:52:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-de1e6999-ea3f-49ae-a7ed-02cc42e652c9 req-59486ca4-559d-4d43-985b-f78acc0ff2ae service nova] Lock "23931909-81f4-44fb-b936-10a27c16febb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:52:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-de1e6999-ea3f-49ae-a7ed-02cc42e652c9 req-59486ca4-559d-4d43-985b-f78acc0ff2ae service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] No waiting events found dispatching network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:52:46 user nova-compute[72520]: WARNING nova.compute.manager [req-de1e6999-ea3f-49ae-a7ed-02cc42e652c9 req-59486ca4-559d-4d43-985b-f78acc0ff2ae service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received unexpected event network-vif-plugged-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 for instance with vm_state deleted and task_state None.
Aug 02 23:52:46 user nova-compute[72520]: DEBUG nova.compute.manager [req-de1e6999-ea3f-49ae-a7ed-02cc42e652c9 req-59486ca4-559d-4d43-985b-f78acc0ff2ae service nova] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Received event network-vif-deleted-1a9d8d42-4068-4f3d-8bda-ce8b4fa81f72 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:52:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:57 user nova-compute[72520]: INFO nova.compute.manager [None req-337c3f17-4561-4aad-896e-40fa49bde4d0 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Get console output
Aug 02 23:52:57 user nova-compute[72520]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 02 23:52:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:52:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:52:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:52:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:52:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating instance_info_cache with network_info: [{"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:52:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-fb121921-3b3c-43dc-ad9a-8aa1d5c49301" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:52:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:52:58 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:58 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:58 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:52:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:52:59 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020364.5703928, 23931909-81f4-44fb-b936-10a27c16febb => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:52:59 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 23931909-81f4-44fb-b936-10a27c16febb] VM Stopped (Lifecycle Event)
Aug 02 23:52:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-50053522-7572-43c2-9632-4b3554ce54a4 None None] [instance: 23931909-81f4-44fb-b936-10a27c16febb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:52:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:01 user nova-compute[72520]: INFO nova.compute.manager [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Terminating instance
Aug 02 23:53:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-d922288a-07ee-4fb7-9063-ea04f076cbbf req-0cf57f3e-4ea4-40a8-99b7-840e83a9ac03 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-unplugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d922288a-07ee-4fb7-9063-ea04f076cbbf req-0cf57f3e-4ea4-40a8-99b7-840e83a9ac03 service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d922288a-07ee-4fb7-9063-ea04f076cbbf req-0cf57f3e-4ea4-40a8-99b7-840e83a9ac03 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d922288a-07ee-4fb7-9063-ea04f076cbbf req-0cf57f3e-4ea4-40a8-99b7-840e83a9ac03 service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-d922288a-07ee-4fb7-9063-ea04f076cbbf req-0cf57f3e-4ea4-40a8-99b7-840e83a9ac03 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-unplugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-d922288a-07ee-4fb7-9063-ea04f076cbbf req-0cf57f3e-4ea4-40a8-99b7-840e83a9ac03 service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-unplugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:53:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Instance destroyed successfully.
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'resources' on Instance uuid 06f97de2-7a1f-4fc4-92cb-27e08df31263 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646579882',display_name='tempest-TestMinimumBasicScenario-server-646579882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646579882',id=29,image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm+lQlr4C68vf2L3WNELyzZM6+9+z5v54RWQE//K+Rt5Dxcs7aOI+QVJsGj4ECNsYlJs3O6wqYSsQONvn5Xe0sMITk9hqdLPEnYoqMO0YQVGzu95vqn/DwHV3JOqzzajg==',key_name='tempest-TestMinimumBasicScenario-469330076',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-08ty7096',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='240d88aa-9816-4486-bc0b-54184b80e54e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:50:21Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=06f97de2-7a1f-4fc4-92cb-27e08df31263,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "cb421f82-bf44-46ba-98c0-83c543190284", "address": "fa:16:3e:f9:fe:42", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb421f82-bf", "ovs_interfaceid": "cb421f82-bf44-46ba-98c0-83c543190284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG os_vif [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb421f82-bf, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:02 user nova-compute[72520]: INFO os_vif [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fe:42,bridge_name='br-int',has_traffic_filtering=True,id=cb421f82-bf44-46ba-98c0-83c543190284,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb421f82-bf')
Aug 02 23:53:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Deleting instance files /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263_del
Aug 02 23:53:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Deletion of /opt/stack/data/nova/instances/06f97de2-7a1f-4fc4-92cb-27e08df31263_del complete
Aug 02 23:53:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 02 23:53:02 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:02 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Took 0.58 seconds to deallocate network for instance.
Aug 02 23:53:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-14939714-9af6-4bcc-99d9-14b0bc379e0c req-7b31dff4-9090-4c46-a791-161f15af21ee service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-deleted-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.035s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:53:03 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Deleted allocations for instance 06f97de2-7a1f-4fc4-92cb-27e08df31263
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d0cc3bfd-c081-40ea-a4cb-80f98ed58d20 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.091s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-52e032d4-eb58-4ff0-935b-21cedf597ad0 req-e69d47c8-c7b7-4a2d-a72c-bd8649d2292c service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-52e032d4-eb58-4ff0-935b-21cedf597ad0 req-e69d47c8-c7b7-4a2d-a72c-bd8649d2292c service nova] Acquiring lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-52e032d4-eb58-4ff0-935b-21cedf597ad0 req-e69d47c8-c7b7-4a2d-a72c-bd8649d2292c service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-52e032d4-eb58-4ff0-935b-21cedf597ad0 req-e69d47c8-c7b7-4a2d-a72c-bd8649d2292c service nova] Lock "06f97de2-7a1f-4fc4-92cb-27e08df31263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-52e032d4-eb58-4ff0-935b-21cedf597ad0 req-e69d47c8-c7b7-4a2d-a72c-bd8649d2292c service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] No waiting events found dispatching network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:03 user nova-compute[72520]: WARNING nova.compute.manager [req-52e032d4-eb58-4ff0-935b-21cedf597ad0 req-e69d47c8-c7b7-4a2d-a72c-bd8649d2292c service nova] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Received unexpected event network-vif-plugged-cb421f82-bf44-46ba-98c0-83c543190284 for instance with vm_state deleted and task_state None.
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:53:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:53:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8065MB free_disk=25.205669403076172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a1103e2e-7595-4cb7-89ff-dda2fa121ad9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 982bd91f-8b1a-41b2-ad23-3d31136de392 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:53:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:53:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:53:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:53:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:17 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020382.2538838, 06f97de2-7a1f-4fc4-92cb-27e08df31263 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:53:17 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] VM Stopped (Lifecycle Event)
Aug 02 23:53:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d41f8dd6-eb93-49db-8ac4-2905837fe047 None None] [instance: 06f97de2-7a1f-4fc4-92cb-27e08df31263] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:53:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:34 user nova-compute[72520]: INFO nova.compute.manager [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Terminating instance
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-96cf0e58-2d97-4b21-a3e5-27bdd1f5b9da req-cc4fb193-af6d-4c1c-b987-3c4ec1caeb34 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96cf0e58-2d97-4b21-a3e5-27bdd1f5b9da req-cc4fb193-af6d-4c1c-b987-3c4ec1caeb34 service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96cf0e58-2d97-4b21-a3e5-27bdd1f5b9da req-cc4fb193-af6d-4c1c-b987-3c4ec1caeb34 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-96cf0e58-2d97-4b21-a3e5-27bdd1f5b9da req-cc4fb193-af6d-4c1c-b987-3c4ec1caeb34 service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-96cf0e58-2d97-4b21-a3e5-27bdd1f5b9da req-cc4fb193-af6d-4c1c-b987-3c4ec1caeb34 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-96cf0e58-2d97-4b21-a3e5-27bdd1f5b9da req-cc4fb193-af6d-4c1c-b987-3c4ec1caeb34 service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-unplugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Instance destroyed successfully.
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lazy-loading 'resources' on Instance uuid f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-944685915',display_name='tempest-ServerRescueNegativeTestJSON-server-944685915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-944685915',id=16,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:41:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb887059a9634cce9f17319a980a18f4',ramdisk_id='',reservation_id='r-5exu2j08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1442912244',owner_user_name='tempest-ServerRescueNegativeTestJSON-1442912244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:43:12Z,user_data=None,user_id='d02269696a0d47738d8daa53d44b3b70',uuid=f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converting VIF {"id": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "address": "fa:16:3e:de:bc:6e", "network": {"id": "67e8cb78-e294-4f96-b4ed-aa7f3846ae54", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1127876702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb887059a9634cce9f17319a980a18f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb39f0-4b", "ovs_interfaceid": "adfb39f0-4b80-4170-b389-d4d0fe8cd860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG os_vif [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadfb39f0-4b, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:34 user nova-compute[72520]: INFO os_vif [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:bc:6e,bridge_name='br-int',has_traffic_filtering=True,id=adfb39f0-4b80-4170-b389-d4d0fe8cd860,network=Network(67e8cb78-e294-4f96-b4ed-aa7f3846ae54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb39f0-4b')
Aug 02 23:53:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Deleting instance files /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf_del
Aug 02 23:53:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Deletion of /opt/stack/data/nova/instances/f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf_del complete
Aug 02 23:53:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:35 user nova-compute[72520]: INFO nova.compute.manager [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 02 23:53:35 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:35 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Took 0.52 seconds to deallocate network for instance.
Aug 02 23:53:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-3ec0d2b7-550f-4bac-b348-5e4a3db2b651 req-80d0e194-580f-46de-bc73-e36d90778b3b service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-deleted-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:53:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:35 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Deleted allocations for instance f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf
Aug 02 23:53:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-dbb1ff53-47ed-4bdd-b443-15db43e459b1 tempest-ServerRescueNegativeTestJSON-1442912244 tempest-ServerRescueNegativeTestJSON-1442912244-project-member] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.705s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-d4406461-c481-4df6-b345-c994febedd34 req-e77985d0-fe91-4808-a3f3-734242b08ddd service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d4406461-c481-4df6-b345-c994febedd34 req-e77985d0-fe91-4808-a3f3-734242b08ddd service nova] Acquiring lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d4406461-c481-4df6-b345-c994febedd34 req-e77985d0-fe91-4808-a3f3-734242b08ddd service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d4406461-c481-4df6-b345-c994febedd34 req-e77985d0-fe91-4808-a3f3-734242b08ddd service nova] Lock "f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-d4406461-c481-4df6-b345-c994febedd34 req-e77985d0-fe91-4808-a3f3-734242b08ddd service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] No waiting events found dispatching network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:36 user nova-compute[72520]: WARNING nova.compute.manager [req-d4406461-c481-4df6-b345-c994febedd34 req-e77985d0-fe91-4808-a3f3-734242b08ddd service nova] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Received unexpected event network-vif-plugged-adfb39f0-4b80-4170-b389-d4d0fe8cd860 for instance with vm_state deleted and task_state None.
Aug 02 23:53:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:53:44 user nova-compute[72520]: INFO nova.compute.claims [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Claim successful on node user
Aug 02 23:53:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:45 user nova-compute[72520]: INFO nova.compute.manager [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Terminating instance
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:53:45 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.policy [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '333b602f3a894e4e84db31594de293c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c4d33b6caa44d6945a836e0b19ba10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-707330bd-8cff-4d0a-9120-e55e9df0617f req-a875ef40-12c8-494f-90c6-1b340c16ccff service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-707330bd-8cff-4d0a-9120-e55e9df0617f req-a875ef40-12c8-494f-90c6-1b340c16ccff service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-707330bd-8cff-4d0a-9120-e55e9df0617f req-a875ef40-12c8-494f-90c6-1b340c16ccff service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-707330bd-8cff-4d0a-9120-e55e9df0617f req-a875ef40-12c8-494f-90c6-1b340c16ccff service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-707330bd-8cff-4d0a-9120-e55e9df0617f req-a875ef40-12c8-494f-90c6-1b340c16ccff service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-707330bd-8cff-4d0a-9120-e55e9df0617f req-a875ef40-12c8-494f-90c6-1b340c16ccff service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-unplugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:53:45 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Creating image(s)
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "/opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "/opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.158s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.192s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk 1073741824" returned: 0 in 0.061s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:45 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Instance destroyed successfully.
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.objects.instance [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'resources' on Instance uuid a1103e2e-7595-4cb7-89ff-dda2fa121ad9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1534305402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1534305402',id=30,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-7pn4563d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:51:59Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=a1103e2e-7595-4cb7-89ff-dda2fa121ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "51365aea-040d-4f66-bf48-ae79c5371e1b", "address": "fa:16:3e:f1:5f:6f", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51365aea-04", "ovs_interfaceid": "51365aea-040d-4f66-bf48-ae79c5371e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG os_vif [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51365aea-04, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:45 user nova-compute[72520]: INFO os_vif [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:5f:6f,bridge_name='br-int',has_traffic_filtering=True,id=51365aea-040d-4f66-bf48-ae79c5371e1b,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51365aea-04')
Aug 02 23:53:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgcVhOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:53:45 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:53:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:53:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1c47d5-aa3e-4c4f-adef-969bd54c8213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72d8ebd-941d-4eeb-8bb3-b196365faafa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:53:46 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:53:46 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:53:46 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:53:46 user nova-compute[72520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d (non-flash)
Aug 02 23:53:46 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:53:46 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4278280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d'): ({'sde'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Removing single pathed devices sde {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28d102-eda8-4029-8bb4-cc4ee8451b85]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7091b11-1c6a-4ca2-8112-f60be3c1d355]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flushing IO for device /dev/sde {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab7d75-c129-44e1-8644-6b0aa862706d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Cannot resize image /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'migration_context' on Instance uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Ensure instance console log exists: /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.200s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[609dfb94-d615-4f25-becf-c6e858b8001c]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] SCSI volumes sde have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f082d9e4-59e7-4b9d-91f0-e6433ccc764c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Successfully created port: 3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63558f98-44a2-44fe-8ab9-35c6a3e96469]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260]
Aug 02 23:53:46 user nova-compute[72520]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d, portal: 172.16.0.220,3260] successful.
Aug 02 23:53:46 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e22842-5ac4-43df-bb63-d31dba32bf7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9aca98-1967-4df3-9b14-0bb0a4a7af0b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.500s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== disconnect_volume: return (502ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:53:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Deleting instance files /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9_del
Aug 02 23:53:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Deletion of /opt/stack/data/nova/instances/a1103e2e-7595-4cb7-89ff-dda2fa121ad9_del complete
Aug 02 23:53:46 user nova-compute[72520]: INFO nova.compute.manager [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 02 23:53:46 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:53:46 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:47 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Took 0.54 seconds to deallocate network for instance.
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-98e6d527-f8b4-47b6-a72a-11a2671de0e9 req-58704929-9d47-4336-9711-294e6f8441f6 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-deleted-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:47 user nova-compute[72520]: INFO nova.compute.manager [req-98e6d527-f8b4-47b6-a72a-11a2671de0e9 req-58704929-9d47-4336-9711-294e6f8441f6 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Neutron deleted interface 51365aea-040d-4f66-bf48-ae79c5371e1b; detaching it from the instance and deleting it from the info cache
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [req-98e6d527-f8b4-47b6-a72a-11a2671de0e9 req-58704929-9d47-4336-9711-294e6f8441f6 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-98e6d527-f8b4-47b6-a72a-11a2671de0e9 req-58704929-9d47-4336-9711-294e6f8441f6 service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Detach interface failed, port_id=51365aea-040d-4f66-bf48-ae79c5371e1b, reason: Instance a1103e2e-7595-4cb7-89ff-dda2fa121ad9 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Successfully updated port: 3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquired lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-changed-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Refreshing instance network info cache due to event network-changed-3158f43d-a8c5-491d-b239-dda5a2a4b980. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] Acquiring lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-1be50b27-1ec0-49c4-b140-f9e1d3cffae4 req-f5284b62-1f4e-49d3-b1b8-c098f04b8e0a service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1be50b27-1ec0-49c4-b140-f9e1d3cffae4 req-f5284b62-1f4e-49d3-b1b8-c098f04b8e0a service nova] Acquiring lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1be50b27-1ec0-49c4-b140-f9e1d3cffae4 req-f5284b62-1f4e-49d3-b1b8-c098f04b8e0a service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1be50b27-1ec0-49c4-b140-f9e1d3cffae4 req-f5284b62-1f4e-49d3-b1b8-c098f04b8e0a service nova] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.compute.manager [req-1be50b27-1ec0-49c4-b140-f9e1d3cffae4 req-f5284b62-1f4e-49d3-b1b8-c098f04b8e0a service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] No waiting events found dispatching network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:47 user nova-compute[72520]: WARNING nova.compute.manager [req-1be50b27-1ec0-49c4-b140-f9e1d3cffae4 req-f5284b62-1f4e-49d3-b1b8-c098f04b8e0a service nova] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Received unexpected event network-vif-plugged-51365aea-040d-4f66-bf48-ae79c5371e1b for instance with vm_state active and task_state deleting.
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Releasing lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Instance network_info: |[{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] Acquired lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Refreshing network info cache for port 3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Start _get_guest_xml network_info=[{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:53:47 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:53:47 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-532068730',display_name='tempest-TestStampPattern-server-532068730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-532068730',id=32,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfr+fZTq73vPqi3KD8xg6zCQNhY3yvgp2jBtELhyFONrVCY4fZPONJM5IwmbDaDaDReMtv/cCmZk6EIIRiMsEWdetIL8IFplnshiRssnbg415aZgohbu0Rd9qgWXAMv6g==',key_name='tempest-TestStampPattern-2115296246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0c4d33b6caa44d6945a836e0b19ba10',ramdisk_id='',reservation_id='r-m3m98nu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-163390428',owner_user_name='tempest-TestStampPattern-163390428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:53:45Z,user_data=None,user_id='333b602f3a894e4e84db31594de293c7',uuid=0fa3db91-fd75-47e6-bce0-f612e5afe5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converting VIF {"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:a0,bridge_name='br-int',has_traffic_filtering=True,id=3158f43d-a8c5-491d-b239-dda5a2a4b980,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3158f43d-a8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:53:47 user nova-compute[72520]:   <uuid>0fa3db91-fd75-47e6-bce0-f612e5afe5c0</uuid>
Aug 02 23:53:47 user nova-compute[72520]:   <name>instance-00000020</name>
Aug 02 23:53:47 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:53:47 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:53:47 user nova-compute[72520]:   <metadata>
Aug 02 23:53:47 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:53:47 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:53:47 user nova-compute[72520]:       <nova:name>tempest-TestStampPattern-server-532068730</nova:name>
Aug 02 23:53:47 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:53:47</nova:creationTime>
Aug 02 23:53:47 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:53:47 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:53:47 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:53:47 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:53:47 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:53:47 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:53:47 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:53:47 user nova-compute[72520]:       <nova:owner>
Aug 02 23:53:47 user nova-compute[72520]:         <nova:user uuid="333b602f3a894e4e84db31594de293c7">tempest-TestStampPattern-163390428-project-member</nova:user>
Aug 02 23:53:47 user nova-compute[72520]:         <nova:project uuid="f0c4d33b6caa44d6945a836e0b19ba10">tempest-TestStampPattern-163390428</nova:project>
Aug 02 23:53:47 user nova-compute[72520]:       </nova:owner>
Aug 02 23:53:47 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:53:47 user nova-compute[72520]:       <nova:ports>
Aug 02 23:53:47 user nova-compute[72520]:         <nova:port uuid="3158f43d-a8c5-491d-b239-dda5a2a4b980">
Aug 02 23:53:47 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 02 23:53:47 user nova-compute[72520]:         </nova:port>
Aug 02 23:53:47 user nova-compute[72520]:       </nova:ports>
Aug 02 23:53:47 user nova-compute[72520]:     </nova:instance>
Aug 02 23:53:47 user nova-compute[72520]:   </metadata>
Aug 02 23:53:47 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:53:47 user nova-compute[72520]:     <system>
Aug 02 23:53:47 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:53:47 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:53:47 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:53:47 user nova-compute[72520]:       <entry name="serial">0fa3db91-fd75-47e6-bce0-f612e5afe5c0</entry>
Aug 02 23:53:47 user nova-compute[72520]:       <entry name="uuid">0fa3db91-fd75-47e6-bce0-f612e5afe5c0</entry>
Aug 02 23:53:47 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:53:47 user nova-compute[72520]:     </system>
Aug 02 23:53:47 user nova-compute[72520]:   </sysinfo>
Aug 02 23:53:47 user nova-compute[72520]:   <os>
Aug 02 23:53:47 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:53:47 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:53:47 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:53:47 user nova-compute[72520]:   </os>
Aug 02 23:53:47 user nova-compute[72520]:   <features>
Aug 02 23:53:47 user nova-compute[72520]:     <acpi/>
Aug 02 23:53:47 user nova-compute[72520]:     <apic/>
Aug 02 23:53:47 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:53:47 user nova-compute[72520]:   </features>
Aug 02 23:53:47 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:53:47 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:53:47 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:53:47 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:53:47 user nova-compute[72520]:   </clock>
Aug 02 23:53:47 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:53:47 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:53:47 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:53:47 user nova-compute[72520]:   </cpu>
Aug 02 23:53:47 user nova-compute[72520]:   <devices>
Aug 02 23:53:47 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:53:47 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:53:47 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk"/>
Aug 02 23:53:47 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:53:47 user nova-compute[72520]:     </disk>
Aug 02 23:53:47 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:53:47 user nova-compute[72520]:       <mac address="fa:16:3e:d5:a9:a0"/>
Aug 02 23:53:47 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:53:47 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:53:47 user nova-compute[72520]:       <target dev="tap3158f43d-a8"/>
Aug 02 23:53:47 user nova-compute[72520]:     </interface>
Aug 02 23:53:47 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:53:47 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/console.log" append="off"/>
Aug 02 23:53:47 user nova-compute[72520]:     </serial>
Aug 02 23:53:47 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:53:47 user nova-compute[72520]:     <video>
Aug 02 23:53:47 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:53:47 user nova-compute[72520]:     </video>
Aug 02 23:53:47 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:53:47 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:53:47 user nova-compute[72520]:     </rng>
Aug 02 23:53:47 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:53:47 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:53:47 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:53:47 user nova-compute[72520]:     </memballoon>
Aug 02 23:53:47 user nova-compute[72520]:   </devices>
Aug 02 23:53:47 user nova-compute[72520]: </domain>
Aug 02 23:53:47 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-532068730',display_name='tempest-TestStampPattern-server-532068730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-532068730',id=32,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfr+fZTq73vPqi3KD8xg6zCQNhY3yvgp2jBtELhyFONrVCY4fZPONJM5IwmbDaDaDReMtv/cCmZk6EIIRiMsEWdetIL8IFplnshiRssnbg415aZgohbu0Rd9qgWXAMv6g==',key_name='tempest-TestStampPattern-2115296246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0c4d33b6caa44d6945a836e0b19ba10',ramdisk_id='',reservation_id='r-m3m98nu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-163390428',owner_user_name='tempest-TestStampPattern-163390428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:53:45Z,user_data=None,user_id='333b602f3a894e4e84db31594de293c7',uuid=0fa3db91-fd75-47e6-bce0-f612e5afe5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converting VIF {"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:a0,bridge_name='br-int',has_traffic_filtering=True,id=3158f43d-a8c5-491d-b239-dda5a2a4b980,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3158f43d-a8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG os_vif [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:a0,bridge_name='br-int',has_traffic_filtering=True,id=3158f43d-a8c5-491d-b239-dda5a2a4b980,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3158f43d-a8') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3158f43d-a8, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3158f43d-a8, col_values=(('external_ids', {'iface-id': '3158f43d-a8c5-491d-b239-dda5a2a4b980', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:a9:a0', 'vm-uuid': '0fa3db91-fd75-47e6-bce0-f612e5afe5c0'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:47 user nova-compute[72520]: INFO os_vif [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:a0,bridge_name='br-int',has_traffic_filtering=True,id=3158f43d-a8c5-491d-b239-dda5a2a4b980,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3158f43d-a8')
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No VIF found with MAC fa:16:3e:d5:a9:a0, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:53:47 user nova-compute[72520]: INFO nova.compute.manager [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Took 0.77 seconds to detach 1 volumes for instance.
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updated VIF entry in instance network info cache for port 3158f43d-a8c5-491d-b239-dda5a2a4b980. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG nova.network.neutron [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a6220e29-b405-43b7-bf36-999b39d096b2 req-5e95d2c1-e5fc-4ff2-ae12-7006d97885c0 service nova] Releasing lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:53:48 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:53:48 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:53:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:48 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Deleted allocations for instance a1103e2e-7595-4cb7-89ff-dda2fa121ad9
Aug 02 23:53:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7d33022c-1c7a-4eb1-8e72-7f7f8cf52e2b tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "a1103e2e-7595-4cb7-89ff-dda2fa121ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-b341abce-65e2-4139-98ca-8451d87aecf7 req-4f45e14f-73bc-46e5-ab71-8fd0c37656eb service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b341abce-65e2-4139-98ca-8451d87aecf7 req-4f45e14f-73bc-46e5-ab71-8fd0c37656eb service nova] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b341abce-65e2-4139-98ca-8451d87aecf7 req-4f45e14f-73bc-46e5-ab71-8fd0c37656eb service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b341abce-65e2-4139-98ca-8451d87aecf7 req-4f45e14f-73bc-46e5-ab71-8fd0c37656eb service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-b341abce-65e2-4139-98ca-8451d87aecf7 req-4f45e14f-73bc-46e5-ab71-8fd0c37656eb service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] No waiting events found dispatching network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:49 user nova-compute[72520]: WARNING nova.compute.manager [req-b341abce-65e2-4139-98ca-8451d87aecf7 req-4f45e14f-73bc-46e5-ab71-8fd0c37656eb service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received unexpected event network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 for instance with vm_state building and task_state spawning.
Aug 02 23:53:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:49 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020414.8650067, f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:53:49 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] VM Stopped (Lifecycle Event)
Aug 02 23:53:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-18746f69-8988-4dd7-aa98-d634fba14dc9 None None] [instance: f7b062ff-7053-4f4f-bb1c-e6ccfb8d0acf] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020431.0766304, 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:53:51 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] VM Resumed (Lifecycle Event)
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:53:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Instance spawned successfully.
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:53:51 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020431.0777607, 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:53:51 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] VM Started (Lifecycle Event)
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:53:51 user nova-compute[72520]: INFO nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:53:51 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-b0ba2fb3-12d1-4f41-9190-5894773f6008 req-69d4478c-c9cf-419c-a47c-dee2ecd8ad5d service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b0ba2fb3-12d1-4f41-9190-5894773f6008 req-69d4478c-c9cf-419c-a47c-dee2ecd8ad5d service nova] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b0ba2fb3-12d1-4f41-9190-5894773f6008 req-69d4478c-c9cf-419c-a47c-dee2ecd8ad5d service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b0ba2fb3-12d1-4f41-9190-5894773f6008 req-69d4478c-c9cf-419c-a47c-dee2ecd8ad5d service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-b0ba2fb3-12d1-4f41-9190-5894773f6008 req-69d4478c-c9cf-419c-a47c-dee2ecd8ad5d service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] No waiting events found dispatching network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:51 user nova-compute[72520]: WARNING nova.compute.manager [req-b0ba2fb3-12d1-4f41-9190-5894773f6008 req-69d4478c-c9cf-419c-a47c-dee2ecd8ad5d service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received unexpected event network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 for instance with vm_state building and task_state spawning.
Aug 02 23:53:51 user nova-compute[72520]: INFO nova.compute.manager [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Took 6.51 seconds to build instance.
Aug 02 23:53:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f42adef3-336f-41ab-b66b-821c9b72480b tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.603s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:53:55 user nova-compute[72520]: INFO nova.compute.claims [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Claim successful on node user
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.network.neutron [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:53:55 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:53:55 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG nova.policy [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7b27a450e444b308fc54577d724cc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b274c7dd5374d739bd700643b0bf63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:53:56 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Creating image(s)
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "/opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "/opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "b80c5d62e69a54a135785c00893c3e21a809ea6a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "b80c5d62e69a54a135785c00893c3e21a809ea6a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG nova.virt.images [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] 1c257d33-0c46-4827-8053-23827139000b was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.part /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG nova.network.neutron [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Successfully created port: b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.part /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.converted" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "b80c5d62e69a54a135785c00893c3e21a809ea6a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.997s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a --force-share --output=json" returned: 0 in 0.175s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "b80c5d62e69a54a135785c00893c3e21a809ea6a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "b80c5d62e69a54a135785c00893c3e21a809ea6a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a,backing_fmt=raw /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a,backing_fmt=raw /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk 1073741824" returned: 0 in 0.059s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "b80c5d62e69a54a135785c00893c3e21a809ea6a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Cannot resize image /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'migration_context' on Instance uuid d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Successfully updated port: b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Ensure instance console log exists: /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing instance network info cache due to event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:53:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Updating instance_info_cache with network_info: [{"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:58 user nova-compute[72520]: INFO nova.compute.manager [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Terminating instance
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance network_info: |[{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Start _get_guest_xml network_info=[{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:53:53Z,direct_url=<?>,disk_format='qcow2',id=1c257d33-0c46-4827-8053-23827139000b,min_disk=0,min_ram=0,name='tempest-scenario-img--177393581',owner='4b274c7dd5374d739bd700643b0bf63e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:53:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '1c257d33-0c46-4827-8053-23827139000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:53:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:53:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:53:53Z,direct_url=<?>,disk_format='qcow2',id=1c257d33-0c46-4827-8053-23827139000b,min_disk=0,min_ram=0,name='tempest-scenario-img--177393581',owner='4b274c7dd5374d739bd700643b0bf63e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:53:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335891746',display_name='tempest-TestMinimumBasicScenario-server-1335891746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335891746',id=33,image_ref='1c257d33-0c46-4827-8053-23827139000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg3pz/7Pc297fwE6KJqjswQuc0vk5z0LqvlpfGy2wpsF21uZhtDV9INV971y9p29dTVhSeerl8OPaobfvLGkqJn6N2TAUfTHDGtBVFrPo7sRllOC/5GxS9ju4JkLqLJbw==',key_name='tempest-TestMinimumBasicScenario-250276219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-8z07iel0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c257d33-0c46-4827-8053-23827139000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:53:56Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=d8b74c7b-117b-4f86-a593-d767e6def722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=b996723b-e8bb-4337-adb3-cad586295e6b,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb996723b-e8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.objects.instance [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'pci_devices' on Instance uuid d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:53:58 user nova-compute[72520]:   <uuid>d8b74c7b-117b-4f86-a593-d767e6def722</uuid>
Aug 02 23:53:58 user nova-compute[72520]:   <name>instance-00000021</name>
Aug 02 23:53:58 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:53:58 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:53:58 user nova-compute[72520]:   <metadata>
Aug 02 23:53:58 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:53:58 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:53:58 user nova-compute[72520]:       <nova:name>tempest-TestMinimumBasicScenario-server-1335891746</nova:name>
Aug 02 23:53:58 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:53:58</nova:creationTime>
Aug 02 23:53:58 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:53:58 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:53:58 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:53:58 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:53:58 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:53:58 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:53:58 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:53:58 user nova-compute[72520]:       <nova:owner>
Aug 02 23:53:58 user nova-compute[72520]:         <nova:user uuid="c7b27a450e444b308fc54577d724cc7a">tempest-TestMinimumBasicScenario-951726597-project-member</nova:user>
Aug 02 23:53:58 user nova-compute[72520]:         <nova:project uuid="4b274c7dd5374d739bd700643b0bf63e">tempest-TestMinimumBasicScenario-951726597</nova:project>
Aug 02 23:53:58 user nova-compute[72520]:       </nova:owner>
Aug 02 23:53:58 user nova-compute[72520]:       <nova:root type="image" uuid="1c257d33-0c46-4827-8053-23827139000b"/>
Aug 02 23:53:58 user nova-compute[72520]:       <nova:ports>
Aug 02 23:53:58 user nova-compute[72520]:         <nova:port uuid="b996723b-e8bb-4337-adb3-cad586295e6b">
Aug 02 23:53:58 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 02 23:53:58 user nova-compute[72520]:         </nova:port>
Aug 02 23:53:58 user nova-compute[72520]:       </nova:ports>
Aug 02 23:53:58 user nova-compute[72520]:     </nova:instance>
Aug 02 23:53:58 user nova-compute[72520]:   </metadata>
Aug 02 23:53:58 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:53:58 user nova-compute[72520]:     <system>
Aug 02 23:53:58 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:53:58 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:53:58 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:53:58 user nova-compute[72520]:       <entry name="serial">d8b74c7b-117b-4f86-a593-d767e6def722</entry>
Aug 02 23:53:58 user nova-compute[72520]:       <entry name="uuid">d8b74c7b-117b-4f86-a593-d767e6def722</entry>
Aug 02 23:53:58 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:53:58 user nova-compute[72520]:     </system>
Aug 02 23:53:58 user nova-compute[72520]:   </sysinfo>
Aug 02 23:53:58 user nova-compute[72520]:   <os>
Aug 02 23:53:58 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:53:58 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:53:58 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:53:58 user nova-compute[72520]:   </os>
Aug 02 23:53:58 user nova-compute[72520]:   <features>
Aug 02 23:53:58 user nova-compute[72520]:     <acpi/>
Aug 02 23:53:58 user nova-compute[72520]:     <apic/>
Aug 02 23:53:58 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:53:58 user nova-compute[72520]:   </features>
Aug 02 23:53:58 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:53:58 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:53:58 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:53:58 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:53:58 user nova-compute[72520]:   </clock>
Aug 02 23:53:58 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:53:58 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:53:58 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:53:58 user nova-compute[72520]:   </cpu>
Aug 02 23:53:58 user nova-compute[72520]:   <devices>
Aug 02 23:53:58 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:53:58 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:53:58 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk"/>
Aug 02 23:53:58 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:53:58 user nova-compute[72520]:     </disk>
Aug 02 23:53:58 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:53:58 user nova-compute[72520]:       <mac address="fa:16:3e:a6:ab:a8"/>
Aug 02 23:53:58 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:53:58 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:53:58 user nova-compute[72520]:       <target dev="tapb996723b-e8"/>
Aug 02 23:53:58 user nova-compute[72520]:     </interface>
Aug 02 23:53:58 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:53:58 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/console.log" append="off"/>
Aug 02 23:53:58 user nova-compute[72520]:     </serial>
Aug 02 23:53:58 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:53:58 user nova-compute[72520]:     <video>
Aug 02 23:53:58 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:53:58 user nova-compute[72520]:     </video>
Aug 02 23:53:58 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:53:58 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:53:58 user nova-compute[72520]:     </rng>
Aug 02 23:53:58 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:53:58 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:53:58 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:53:58 user nova-compute[72520]:     </memballoon>
Aug 02 23:53:58 user nova-compute[72520]:   </devices>
Aug 02 23:53:58 user nova-compute[72520]: </domain>
Aug 02 23:53:58 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335891746',display_name='tempest-TestMinimumBasicScenario-server-1335891746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335891746',id=33,image_ref='1c257d33-0c46-4827-8053-23827139000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg3pz/7Pc297fwE6KJqjswQuc0vk5z0LqvlpfGy2wpsF21uZhtDV9INV971y9p29dTVhSeerl8OPaobfvLGkqJn6N2TAUfTHDGtBVFrPo7sRllOC/5GxS9ju4JkLqLJbw==',key_name='tempest-TestMinimumBasicScenario-250276219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-8z07iel0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c257d33-0c46-4827-8053-23827139000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:53:56Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=d8b74c7b-117b-4f86-a593-d767e6def722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=b996723b-e8bb-4337-adb3-cad586295e6b,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb996723b-e8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG os_vif [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=b996723b-e8bb-4337-adb3-cad586295e6b,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb996723b-e8') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb996723b-e8, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb996723b-e8, col_values=(('external_ids', {'iface-id': 'b996723b-e8bb-4337-adb3-cad586295e6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:ab:a8', 'vm-uuid': 'd8b74c7b-117b-4f86-a593-d767e6def722'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: INFO os_vif [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=b996723b-e8bb-4337-adb3-cad586295e6b,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb996723b-e8')
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No VIF found with MAC fa:16:3e:a6:ab:a8, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-f4481bb9-c6cc-40f9-806a-3a91128cd6ea req-3db82e3f-d6aa-4b57-90ce-0f19685f7db5 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-unplugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f4481bb9-c6cc-40f9-806a-3a91128cd6ea req-3db82e3f-d6aa-4b57-90ce-0f19685f7db5 service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f4481bb9-c6cc-40f9-806a-3a91128cd6ea req-3db82e3f-d6aa-4b57-90ce-0f19685f7db5 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f4481bb9-c6cc-40f9-806a-3a91128cd6ea req-3db82e3f-d6aa-4b57-90ce-0f19685f7db5 service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-f4481bb9-c6cc-40f9-806a-3a91128cd6ea req-3db82e3f-d6aa-4b57-90ce-0f19685f7db5 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-unplugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-f4481bb9-c6cc-40f9-806a-3a91128cd6ea req-3db82e3f-d6aa-4b57-90ce-0f19685f7db5 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-unplugged-06065754-8489-41bd-acb5-f264f5633570 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updated VIF entry in instance network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:53:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-37e596f4-dd10-4fd8-bad8-c79a82c1c9a2 req-9f7f76ae-6999-4859-98c4-817d506e69c1 service nova] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Instance destroyed successfully.
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.objects.instance [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'resources' on Instance uuid 982bd91f-8b1a-41b2-ad23-3d31136de392 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1912665491',display_name='tempest-ServerActionsTestOtherA-server-1912665491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1912665491',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-oyl88jgm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=982bd91f-8b1a-41b2-ad23-3d31136de392,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "06065754-8489-41bd-acb5-f264f5633570", "address": "fa:16:3e:35:1c:34", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06065754-84", "ovs_interfaceid": "06065754-8489-41bd-acb5-f264f5633570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_vif [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06065754-84, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:53:59 user nova-compute[72520]: INFO os_vif [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:1c:34,bridge_name='br-int',has_traffic_filtering=True,id=06065754-8489-41bd-acb5-f264f5633570,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06065754-84')
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtCpHbcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:53:59 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67be4715-bb7c-4d9d-a453-a5e1e05ce184]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b26789-007e-4796-9acd-ed53970b4237]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:53:59 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:53:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:53:59 user nova-compute[72520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca (non-flash)
Aug 02 23:53:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce42331c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f513159-7945-450b-8cc3-0dec312b734e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c971cc-7f14-40db-876c-22bd9fcb75d5]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a25068-aa54-40aa-be63-1a6f6a4e86b6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6ff4f-cb42-4ac6-84a6-a39975a192fe]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_194f077', '/dev/disk/by-id/scsi-1SCST_BIO194f077-1159c01c6cc92ba3', '/dev/disk/by-id/scsi-23131353963303163') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dab307-0784-4def-b1be-3146b2697356]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[483cd9aa-bb77-47cb-a678-6481d544f1eb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[41403237-c4c2-4607-97d3-8c9a738cbe26]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260]
Aug 02 23:53:59 user nova-compute[72520]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca, portal: 172.16.0.220,3260] successful.
Aug 02 23:53:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d325d2-c6a9-4a72-a5e9-a45c3d645fca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05c1b1-4fd1-4358-910e-e97533946e5c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] <== disconnect_volume: return (274ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:53:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Deleting instance files /opt/stack/data/nova/instances/982bd91f-8b1a-41b2-ad23-3d31136de392_del
Aug 02 23:53:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Deletion of /opt/stack/data/nova/instances/982bd91f-8b1a-41b2-ad23-3d31136de392_del complete
Aug 02 23:53:59 user nova-compute[72520]: INFO nova.compute.manager [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Took 1.65 seconds to destroy the instance on the hypervisor.
Aug 02 23:53:59 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:53:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] Acquiring lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] No waiting events found dispatching network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:00 user nova-compute[72520]: WARNING nova.compute.manager [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received unexpected event network-vif-plugged-06065754-8489-41bd-acb5-f264f5633570 for instance with vm_state active and task_state deleting.
Aug 02 23:54:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:00 user nova-compute[72520]: WARNING nova.compute.manager [req-5db19092-5b1d-47cb-bb48-954ec37ab4cd req-186323b0-08dc-4daf-b5e9-ac51e7a96e3f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received unexpected event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with vm_state building and task_state spawning.
Aug 02 23:54:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:00 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020425.881471, a1103e2e-7595-4cb7-89ff-dda2fa121ad9 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:54:00 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] VM Stopped (Lifecycle Event)
Aug 02 23:54:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-2ec3632e-e968-4dd3-8878-552a52986b4e None None] [instance: a1103e2e-7595-4cb7-89ff-dda2fa121ad9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:01 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:54:01 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Took 1.54 seconds to deallocate network for instance.
Aug 02 23:54:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-998a8d9a-ac67-42cf-93d7-9a14431c0a9c req-dc6f437c-c244-48c6-8dcb-ca5fd628c3e4 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Received event network-vif-deleted-06065754-8489-41bd-acb5-f264f5633570 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:01 user nova-compute[72520]: INFO nova.compute.manager [req-998a8d9a-ac67-42cf-93d7-9a14431c0a9c req-dc6f437c-c244-48c6-8dcb-ca5fd628c3e4 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Neutron deleted interface 06065754-8489-41bd-acb5-f264f5633570; detaching it from the instance and deleting it from the info cache
Aug 02 23:54:01 user nova-compute[72520]: DEBUG nova.network.neutron [req-998a8d9a-ac67-42cf-93d7-9a14431c0a9c req-dc6f437c-c244-48c6-8dcb-ca5fd628c3e4 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:54:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-998a8d9a-ac67-42cf-93d7-9a14431c0a9c req-dc6f437c-c244-48c6-8dcb-ca5fd628c3e4 service nova] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Detach interface failed, port_id=06065754-8489-41bd-acb5-f264f5633570, reason: Instance 982bd91f-8b1a-41b2-ad23-3d31136de392 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.compute.manager [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Took 0.70 seconds to detach 1 volumes for instance.
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Deleting volume: 91d325d2-c6a9-4a72-a5e9-a45c3d645fca {{(pid=72520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020442.202432, d8b74c7b-117b-4f86-a593-d767e6def722 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] VM Resumed (Lifecycle Event)
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance spawned successfully.
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020442.2027502, d8b74c7b-117b-4f86-a593-d767e6def722 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] VM Started (Lifecycle Event)
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.compute.manager [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Took 6.94 seconds to build instance.
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-73b6ae7a-15d5-4662-8661-888e49f4982e tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.028s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:02 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Deleted allocations for instance 982bd91f-8b1a-41b2-ad23-3d31136de392
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-3facba69-baf2-4daf-93d0-0a3075f8bccd req-14e12be6-b12f-40d9-bd12-1b7b1b6d4803 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3facba69-baf2-4daf-93d0-0a3075f8bccd req-14e12be6-b12f-40d9-bd12-1b7b1b6d4803 service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3facba69-baf2-4daf-93d0-0a3075f8bccd req-14e12be6-b12f-40d9-bd12-1b7b1b6d4803 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3facba69-baf2-4daf-93d0-0a3075f8bccd req-14e12be6-b12f-40d9-bd12-1b7b1b6d4803 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-3facba69-baf2-4daf-93d0-0a3075f8bccd req-14e12be6-b12f-40d9-bd12-1b7b1b6d4803 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:02 user nova-compute[72520]: WARNING nova.compute.manager [req-3facba69-baf2-4daf-93d0-0a3075f8bccd req-14e12be6-b12f-40d9-bd12-1b7b1b6d4803 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received unexpected event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with vm_state active and task_state None.
Aug 02 23:54:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-224867f9-56db-4f44-9824-f3965290bad4 tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "982bd91f-8b1a-41b2-ad23-3d31136de392" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.467s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:54:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:54:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:54:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:54:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:54:07 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:54:07 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=25.173988342285156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d8b74c7b-117b-4f86-a593-d767e6def722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:54:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:14 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020439.3493464, 982bd91f-8b1a-41b2-ad23-3d31136de392 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:54:14 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] VM Stopped (Lifecycle Event)
Aug 02 23:54:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-4056b809-29f9-413d-be4a-1297b81c6f61 None None] [instance: 982bd91f-8b1a-41b2-ad23-3d31136de392] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:35 user nova-compute[72520]: INFO nova.compute.manager [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Terminating instance
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-f5bc369a-3ab0-499c-acf3-c9f8bbe080c0 req-ffb3b88c-bc43-4740-aefa-33cee2ab3527 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received event network-vif-unplugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f5bc369a-3ab0-499c-acf3-c9f8bbe080c0 req-ffb3b88c-bc43-4740-aefa-33cee2ab3527 service nova] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f5bc369a-3ab0-499c-acf3-c9f8bbe080c0 req-ffb3b88c-bc43-4740-aefa-33cee2ab3527 service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f5bc369a-3ab0-499c-acf3-c9f8bbe080c0 req-ffb3b88c-bc43-4740-aefa-33cee2ab3527 service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-f5bc369a-3ab0-499c-acf3-c9f8bbe080c0 req-ffb3b88c-bc43-4740-aefa-33cee2ab3527 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] No waiting events found dispatching network-vif-unplugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-f5bc369a-3ab0-499c-acf3-c9f8bbe080c0 req-ffb3b88c-bc43-4740-aefa-33cee2ab3527 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received event network-vif-unplugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Instance destroyed successfully.
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.objects.instance [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'resources' on Instance uuid 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-939994510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-939994510',id=27,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-0vi1j2zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:47:09Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=919bee8c-1b0c-4d57-9eda-a9b83d4d3b19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "address": "fa:16:3e:5d:aa:36", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee0bd7f-39", "ovs_interfaceid": "8ee0bd7f-3935-4dd9-947e-055bae95b5d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:aa:36,bridge_name='br-int',has_traffic_filtering=True,id=8ee0bd7f-3935-4dd9-947e-055bae95b5d9,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee0bd7f-39') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG os_vif [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:aa:36,bridge_name='br-int',has_traffic_filtering=True,id=8ee0bd7f-3935-4dd9-947e-055bae95b5d9,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee0bd7f-39') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ee0bd7f-39, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:54:36 user nova-compute[72520]: INFO os_vif [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:aa:36,bridge_name='br-int',has_traffic_filtering=True,id=8ee0bd7f-3935-4dd9-947e-055bae95b5d9,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee0bd7f-39')
Aug 02 23:54:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Deleting instance files /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19_del
Aug 02 23:54:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Deletion of /opt/stack/data/nova/instances/919bee8c-1b0c-4d57-9eda-a9b83d4d3b19_del complete
Aug 02 23:54:36 user nova-compute[72520]: INFO nova.compute.manager [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 02 23:54:36 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:54:36 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:54:37 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:54:37 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Took 0.60 seconds to deallocate network for instance.
Aug 02 23:54:37 user nova-compute[72520]: DEBUG nova.compute.manager [req-f6e30194-a0af-4c45-a903-8eaf86c3c733 req-df496a3b-d787-46d9-9f50-616e816ba901 service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received event network-vif-deleted-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:37 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:54:37 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:54:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:37 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Deleted allocations for instance 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19
Aug 02 23:54:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7f8d301c-1a3b-4d3e-8bf7-fc946e9fda75 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.655s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-199ea13e-b682-4781-a64e-62b49d7d8c4c req-e9756348-2ef2-4069-8b44-f5cfeadfee0b service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received event network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-199ea13e-b682-4781-a64e-62b49d7d8c4c req-e9756348-2ef2-4069-8b44-f5cfeadfee0b service nova] Acquiring lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-199ea13e-b682-4781-a64e-62b49d7d8c4c req-e9756348-2ef2-4069-8b44-f5cfeadfee0b service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-199ea13e-b682-4781-a64e-62b49d7d8c4c req-e9756348-2ef2-4069-8b44-f5cfeadfee0b service nova] Lock "919bee8c-1b0c-4d57-9eda-a9b83d4d3b19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-199ea13e-b682-4781-a64e-62b49d7d8c4c req-e9756348-2ef2-4069-8b44-f5cfeadfee0b service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] No waiting events found dispatching network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:38 user nova-compute[72520]: WARNING nova.compute.manager [req-199ea13e-b682-4781-a64e-62b49d7d8c4c req-e9756348-2ef2-4069-8b44-f5cfeadfee0b service nova] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Received unexpected event network-vif-plugged-8ee0bd7f-3935-4dd9-947e-055bae95b5d9 for instance with vm_state deleted and task_state None.
Aug 02 23:54:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:54:39 user nova-compute[72520]: INFO nova.compute.claims [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Claim successful on node user
Aug 02 23:54:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:54:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.policy [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f9ec64c4b24430e8f7ee755a9f37806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16f380acff84d95b2bfb049709f4246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:54:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Creating image(s)
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk 1073741824" returned: 0 in 0.052s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Successfully created port: cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Cannot resize image /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'migration_context' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Ensure instance console log exists: /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Successfully updated port: cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing instance network info cache due to event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:54:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance network_info: |[{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Start _get_guest_xml network_info=[{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:54:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:54:41 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1538732641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1538732641',id=34,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaQd+V9/52J/QBVoJW+fu0jc4kF0cPPPSztdB4k+LP+O+3cZpKkqQ5qYL8SzbR8hSWHhqV0zC/blRoXw0fsZks6XShfvKnjJSjMzqg8by6uOc80nv5oxz4bni5jbYZvA==',key_name='tempest-keypair-641100772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-4ofkuknn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=4b47e71c-4d43-4727-97ac-a47ff88b6c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:54:41 user nova-compute[72520]:   <uuid>4b47e71c-4d43-4727-97ac-a47ff88b6c2c</uuid>
Aug 02 23:54:41 user nova-compute[72520]:   <name>instance-00000022</name>
Aug 02 23:54:41 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:54:41 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:54:41 user nova-compute[72520]:   <metadata>
Aug 02 23:54:41 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:54:41 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:54:41 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1538732641</nova:name>
Aug 02 23:54:41 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:54:41</nova:creationTime>
Aug 02 23:54:41 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:54:41 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:54:41 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:54:41 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:54:41 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:54:41 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:54:41 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:54:41 user nova-compute[72520]:       <nova:owner>
Aug 02 23:54:41 user nova-compute[72520]:         <nova:user uuid="4f9ec64c4b24430e8f7ee755a9f37806">tempest-AttachVolumeShelveTestJSON-952018091-project-member</nova:user>
Aug 02 23:54:41 user nova-compute[72520]:         <nova:project uuid="a16f380acff84d95b2bfb049709f4246">tempest-AttachVolumeShelveTestJSON-952018091</nova:project>
Aug 02 23:54:41 user nova-compute[72520]:       </nova:owner>
Aug 02 23:54:41 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:54:41 user nova-compute[72520]:       <nova:ports>
Aug 02 23:54:41 user nova-compute[72520]:         <nova:port uuid="cb2a1afa-6a4f-4e19-bd5f-6255baa05956">
Aug 02 23:54:41 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 02 23:54:41 user nova-compute[72520]:         </nova:port>
Aug 02 23:54:41 user nova-compute[72520]:       </nova:ports>
Aug 02 23:54:41 user nova-compute[72520]:     </nova:instance>
Aug 02 23:54:41 user nova-compute[72520]:   </metadata>
Aug 02 23:54:41 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:54:41 user nova-compute[72520]:     <system>
Aug 02 23:54:41 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:54:41 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:54:41 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:54:41 user nova-compute[72520]:       <entry name="serial">4b47e71c-4d43-4727-97ac-a47ff88b6c2c</entry>
Aug 02 23:54:41 user nova-compute[72520]:       <entry name="uuid">4b47e71c-4d43-4727-97ac-a47ff88b6c2c</entry>
Aug 02 23:54:41 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:54:41 user nova-compute[72520]:     </system>
Aug 02 23:54:41 user nova-compute[72520]:   </sysinfo>
Aug 02 23:54:41 user nova-compute[72520]:   <os>
Aug 02 23:54:41 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:54:41 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:54:41 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:54:41 user nova-compute[72520]:   </os>
Aug 02 23:54:41 user nova-compute[72520]:   <features>
Aug 02 23:54:41 user nova-compute[72520]:     <acpi/>
Aug 02 23:54:41 user nova-compute[72520]:     <apic/>
Aug 02 23:54:41 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:54:41 user nova-compute[72520]:   </features>
Aug 02 23:54:41 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:54:41 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:54:41 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:54:41 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:54:41 user nova-compute[72520]:   </clock>
Aug 02 23:54:41 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:54:41 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:54:41 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:54:41 user nova-compute[72520]:   </cpu>
Aug 02 23:54:41 user nova-compute[72520]:   <devices>
Aug 02 23:54:41 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:54:41 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:54:41 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk"/>
Aug 02 23:54:41 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:54:41 user nova-compute[72520]:     </disk>
Aug 02 23:54:41 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:54:41 user nova-compute[72520]:       <mac address="fa:16:3e:e3:9d:06"/>
Aug 02 23:54:41 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:54:41 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:54:41 user nova-compute[72520]:       <target dev="tapcb2a1afa-6a"/>
Aug 02 23:54:41 user nova-compute[72520]:     </interface>
Aug 02 23:54:41 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:54:41 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/console.log" append="off"/>
Aug 02 23:54:41 user nova-compute[72520]:     </serial>
Aug 02 23:54:41 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:54:41 user nova-compute[72520]:     <video>
Aug 02 23:54:41 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:54:41 user nova-compute[72520]:     </video>
Aug 02 23:54:41 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:54:41 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:54:41 user nova-compute[72520]:     </rng>
Aug 02 23:54:41 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:54:41 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:54:41 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:54:41 user nova-compute[72520]:     </memballoon>
Aug 02 23:54:41 user nova-compute[72520]:   </devices>
Aug 02 23:54:41 user nova-compute[72520]: </domain>
Aug 02 23:54:41 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1538732641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1538732641',id=34,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaQd+V9/52J/QBVoJW+fu0jc4kF0cPPPSztdB4k+LP+O+3cZpKkqQ5qYL8SzbR8hSWHhqV0zC/blRoXw0fsZks6XShfvKnjJSjMzqg8by6uOc80nv5oxz4bni5jbYZvA==',key_name='tempest-keypair-641100772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-4ofkuknn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=4b47e71c-4d43-4727-97ac-a47ff88b6c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG os_vif [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb2a1afa-6a, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb2a1afa-6a, col_values=(('external_ids', {'iface-id': 'cb2a1afa-6a4f-4e19-bd5f-6255baa05956', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:9d:06', 'vm-uuid': '4b47e71c-4d43-4727-97ac-a47ff88b6c2c'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:41 user nova-compute[72520]: INFO os_vif [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a')
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No VIF found with MAC fa:16:3e:e3:9d:06, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updated VIF entry in instance network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG nova.network.neutron [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:54:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4675bc52-cf51-4c1a-ab3c-f6595e7db29e req-07ecc5d6-0abe-4dc7-9659-38d15ed1abaf service nova] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-75ea5d11-8dd1-4fae-b2cb-f5133bb9220e req-017e3420-cdb9-4e6f-a620-42b84dfcc77d service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-75ea5d11-8dd1-4fae-b2cb-f5133bb9220e req-017e3420-cdb9-4e6f-a620-42b84dfcc77d service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-75ea5d11-8dd1-4fae-b2cb-f5133bb9220e req-017e3420-cdb9-4e6f-a620-42b84dfcc77d service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-75ea5d11-8dd1-4fae-b2cb-f5133bb9220e req-017e3420-cdb9-4e6f-a620-42b84dfcc77d service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-75ea5d11-8dd1-4fae-b2cb-f5133bb9220e req-017e3420-cdb9-4e6f-a620-42b84dfcc77d service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:42 user nova-compute[72520]: WARNING nova.compute.manager [req-75ea5d11-8dd1-4fae-b2cb-f5133bb9220e req-017e3420-cdb9-4e6f-a620-42b84dfcc77d service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received unexpected event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with vm_state building and task_state spawning.
Aug 02 23:54:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020484.7365103, 4b47e71c-4d43-4727-97ac-a47ff88b6c2c => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:54:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] VM Resumed (Lifecycle Event)
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:54:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance spawned successfully.
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:54:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020484.7397432, 4b47e71c-4d43-4727-97ac-a47ff88b6c2c => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:54:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] VM Started (Lifecycle Event)
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:54:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:54:44 user nova-compute[72520]: INFO nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-fc302478-29b0-4432-bec7-7400207c78ed req-00a14255-277e-47cc-bc6d-c60b739603c8 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fc302478-29b0-4432-bec7-7400207c78ed req-00a14255-277e-47cc-bc6d-c60b739603c8 service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fc302478-29b0-4432-bec7-7400207c78ed req-00a14255-277e-47cc-bc6d-c60b739603c8 service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fc302478-29b0-4432-bec7-7400207c78ed req-00a14255-277e-47cc-bc6d-c60b739603c8 service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-fc302478-29b0-4432-bec7-7400207c78ed req-00a14255-277e-47cc-bc6d-c60b739603c8 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:44 user nova-compute[72520]: WARNING nova.compute.manager [req-fc302478-29b0-4432-bec7-7400207c78ed req-00a14255-277e-47cc-bc6d-c60b739603c8 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received unexpected event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with vm_state building and task_state spawning.
Aug 02 23:54:44 user nova-compute[72520]: INFO nova.compute.manager [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Took 5.83 seconds to build instance.
Aug 02 23:54:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5a66dae7-a0eb-4929-9be8-f67a43d29aff tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.943s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:51 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020476.5647664, 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:54:51 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] VM Stopped (Lifecycle Event)
Aug 02 23:54:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ac74b5a7-454c-464d-8334-6ed7f3c0c932 None None] [instance: 919bee8c-1b0c-4d57-9eda-a9b83d4d3b19] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:53 user nova-compute[72520]: INFO nova.compute.manager [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Terminating instance
Aug 02 23:54:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-2f9f9e40-a79b-46a4-897e-b69301203ed6 req-6027d8a4-d864-4816-9bb1-c885406072b5 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-unplugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2f9f9e40-a79b-46a4-897e-b69301203ed6 req-6027d8a4-d864-4816-9bb1-c885406072b5 service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2f9f9e40-a79b-46a4-897e-b69301203ed6 req-6027d8a4-d864-4816-9bb1-c885406072b5 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2f9f9e40-a79b-46a4-897e-b69301203ed6 req-6027d8a4-d864-4816-9bb1-c885406072b5 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-2f9f9e40-a79b-46a4-897e-b69301203ed6 req-6027d8a4-d864-4816-9bb1-c885406072b5 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-unplugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-2f9f9e40-a79b-46a4-897e-b69301203ed6 req-6027d8a4-d864-4816-9bb1-c885406072b5 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-unplugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:54:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Instance destroyed successfully.
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lazy-loading 'resources' on Instance uuid 6ca3c320-bf1c-43b5-973c-4d73b22487ac {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1926157642',display_name='tempest-ServerActionsTestOtherA-server-1536478268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1926157642',id=20,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJB+MXuvBXd1HF7c3VB0kstNealAUZODgBSvuFBajJP5J243YS7UntKZxalUsX6XhON9dsQc2VPXgoZcoWevU5jFxdM0UaW9R284Q7n/U6voOTpQfHOgIP9lNJ4+488w==',key_name='tempest-keypair-1825995794',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:42:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2f50f35e2b7466ea2a922b0525b2fb1',ramdisk_id='',reservation_id='r-8ioinyiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-102203488',owner_user_name='tempest-ServerActionsTestOtherA-102203488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4848df27d404a9eb33ec7e7dd45dd12',uuid=6ca3c320-bf1c-43b5-973c-4d73b22487ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converting VIF {"id": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "address": "fa:16:3e:4a:23:f6", "network": {"id": "7ad0151a-cd54-411a-9d1e-882432adc1a1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1507770911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2f50f35e2b7466ea2a922b0525b2fb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1bea50-6d", "ovs_interfaceid": "ad1bea50-6df7-41da-b7db-48366aeb40b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG os_vif [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad1bea50-6d, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:54:54 user nova-compute[72520]: INFO os_vif [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:f6,bridge_name='br-int',has_traffic_filtering=True,id=ad1bea50-6df7-41da-b7db-48366aeb40b3,network=Network(7ad0151a-cd54-411a-9d1e-882432adc1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1bea50-6d')
Aug 02 23:54:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Deleting instance files /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac_del
Aug 02 23:54:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Deletion of /opt/stack/data/nova/instances/6ca3c320-bf1c-43b5-973c-4d73b22487ac_del complete
Aug 02 23:54:54 user nova-compute[72520]: INFO nova.compute.manager [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 02 23:54:54 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:54:54 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Took 0.53 seconds to deallocate network for instance.
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-0fd34e17-e2c7-4031-b978-cbd8ab5d20b5 req-40e4f92e-0930-46f9-8e25-abf1ee29a27e service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-deleted-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:54 user nova-compute[72520]: INFO nova.compute.manager [req-0fd34e17-e2c7-4031-b978-cbd8ab5d20b5 req-40e4f92e-0930-46f9-8e25-abf1ee29a27e service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Neutron deleted interface ad1bea50-6df7-41da-b7db-48366aeb40b3; detaching it from the instance and deleting it from the info cache
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-0fd34e17-e2c7-4031-b978-cbd8ab5d20b5 req-40e4f92e-0930-46f9-8e25-abf1ee29a27e service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-0fd34e17-e2c7-4031-b978-cbd8ab5d20b5 req-40e4f92e-0930-46f9-8e25-abf1ee29a27e service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Detach interface failed, port_id=ad1bea50-6df7-41da-b7db-48366aeb40b3, reason: Instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:54:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:54 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Deleted allocations for instance 6ca3c320-bf1c-43b5-973c-4d73b22487ac
Aug 02 23:54:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf548f6b-3075-4deb-a1aa-15cecbca60ce tempest-ServerActionsTestOtherA-102203488 tempest-ServerActionsTestOtherA-102203488-project-member] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b0d230ee-06b7-4fea-af5b-627a5fcd793d req-bca641cc-875b-4eb9-904f-da014ca96056 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:54:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b0d230ee-06b7-4fea-af5b-627a5fcd793d req-bca641cc-875b-4eb9-904f-da014ca96056 service nova] Acquiring lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:54:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b0d230ee-06b7-4fea-af5b-627a5fcd793d req-bca641cc-875b-4eb9-904f-da014ca96056 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:54:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b0d230ee-06b7-4fea-af5b-627a5fcd793d req-bca641cc-875b-4eb9-904f-da014ca96056 service nova] Lock "6ca3c320-bf1c-43b5-973c-4d73b22487ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:54:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-b0d230ee-06b7-4fea-af5b-627a5fcd793d req-bca641cc-875b-4eb9-904f-da014ca96056 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] No waiting events found dispatching network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:54:55 user nova-compute[72520]: WARNING nova.compute.manager [req-b0d230ee-06b7-4fea-af5b-627a5fcd793d req-bca641cc-875b-4eb9-904f-da014ca96056 service nova] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Received unexpected event network-vif-plugged-ad1bea50-6df7-41da-b7db-48366aeb40b3 for instance with vm_state deleted and task_state None.
Aug 02 23:54:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:54:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:55:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 02 23:55:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:55:06 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020494.0035226, 6ca3c320-bf1c-43b5-973c-4d73b22487ac => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:55:09 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] VM Stopped (Lifecycle Event)
Aug 02 23:55:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:55:09 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:55:09 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=25.268436431884766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76d0f275-56ad-469f-8358-0d282e4ddea5 None None] [instance: 6ca3c320-bf1c-43b5-973c-4d73b22487ac] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d8b74c7b-117b-4f86-a593-d767e6def722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:55:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:55:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:55:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:55:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:55:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:26 user nova-compute[72520]: INFO nova.compute.manager [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Terminating instance
Aug 02 23:55:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-c7716469-8746-4b2d-b9af-292e7024dabe req-825ab809-929c-43d1-81a6-0379d72a7eff service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c7716469-8746-4b2d-b9af-292e7024dabe req-825ab809-929c-43d1-81a6-0379d72a7eff service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c7716469-8746-4b2d-b9af-292e7024dabe req-825ab809-929c-43d1-81a6-0379d72a7eff service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c7716469-8746-4b2d-b9af-292e7024dabe req-825ab809-929c-43d1-81a6-0379d72a7eff service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-c7716469-8746-4b2d-b9af-292e7024dabe req-825ab809-929c-43d1-81a6-0379d72a7eff service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-c7716469-8746-4b2d-b9af-292e7024dabe req-825ab809-929c-43d1-81a6-0379d72a7eff service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-unplugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Instance destroyed successfully.
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'resources' on Instance uuid fb121921-3b3c-43dc-ad9a-8aa1d5c49301 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750341404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750341404',id=23,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-w70ajkgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:43:24Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=fb121921-3b3c-43dc-ad9a-8aa1d5c49301,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "bdea32db-5527-45e2-a8ea-970fd468288c", "address": "fa:16:3e:6d:db:2a", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdea32db-55", "ovs_interfaceid": "bdea32db-5527-45e2-a8ea-970fd468288c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_vif [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdea32db-55, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:55:27 user nova-compute[72520]: INFO os_vif [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:db:2a,bridge_name='br-int',has_traffic_filtering=True,id=bdea32db-5527-45e2-a8ea-970fd468288c,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdea32db-55')
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhblzHmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:55:27 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[25987a77-f65d-4e9e-a787-4bdb4268b547]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58152f72-cf51-4154-aaa1-5d7a6f7a0e4c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:55:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 (non-flash)
Aug 02 23:55:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cc4740550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc47bcd2-6f35-4f5c-8b15-6838bffd3072]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[818467aa-adca-487b-a67a-8bde79145354]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e3790e-ea45-4130-90d4-24b4d27a26d6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a5018-e5e0-4f97-8293-2e1bd3e139b6]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15699e3-250c-42a3-970e-172fa3e9ce64]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[60671245-d576-4b53-88e3-3be70bc79616]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260]
Aug 02 23:55:27 user nova-compute[72520]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7, portal: 172.16.0.220,3260] successful.
Aug 02 23:55:27 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9cd575-25cd-4159-8f5f-e28e8af973a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[18654486-417f-4e6f-9b79-db4a2e16f36a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] <== disconnect_volume: return (252ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:55:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Deleting instance files /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301_del
Aug 02 23:55:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Deletion of /opt/stack/data/nova/instances/fb121921-3b3c-43dc-ad9a-8aa1d5c49301_del complete
Aug 02 23:55:27 user nova-compute[72520]: INFO nova.compute.manager [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 02 23:55:27 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:55:27 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:55:28 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:55:28 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Took 0.64 seconds to deallocate network for instance.
Aug 02 23:55:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-6f89746e-ce73-4e57-b9c0-2b87bb1696e1 req-b2b7820f-5fa9-4d8b-a7eb-abd7991765c1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:55:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6f89746e-ce73-4e57-b9c0-2b87bb1696e1 req-b2b7820f-5fa9-4d8b-a7eb-abd7991765c1 service nova] Acquiring lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6f89746e-ce73-4e57-b9c0-2b87bb1696e1 req-b2b7820f-5fa9-4d8b-a7eb-abd7991765c1 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6f89746e-ce73-4e57-b9c0-2b87bb1696e1 req-b2b7820f-5fa9-4d8b-a7eb-abd7991765c1 service nova] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-6f89746e-ce73-4e57-b9c0-2b87bb1696e1 req-b2b7820f-5fa9-4d8b-a7eb-abd7991765c1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] No waiting events found dispatching network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:55:28 user nova-compute[72520]: WARNING nova.compute.manager [req-6f89746e-ce73-4e57-b9c0-2b87bb1696e1 req-b2b7820f-5fa9-4d8b-a7eb-abd7991765c1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received unexpected event network-vif-plugged-bdea32db-5527-45e2-a8ea-970fd468288c for instance with vm_state active and task_state deleting.
Aug 02 23:55:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-6f89746e-ce73-4e57-b9c0-2b87bb1696e1 req-b2b7820f-5fa9-4d8b-a7eb-abd7991765c1 service nova] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Received event network-vif-deleted-bdea32db-5527-45e2-a8ea-970fd468288c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:55:28 user nova-compute[72520]: INFO nova.compute.manager [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Took 0.70 seconds to detach 1 volumes for instance.
Aug 02 23:55:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:29 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:55:29 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:55:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:29 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Deleted allocations for instance fb121921-3b3c-43dc-ad9a-8aa1d5c49301
Aug 02 23:55:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b5ee7b37-5d24-4e2e-b459-9e8c7f23d108 tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "fb121921-3b3c-43dc-ad9a-8aa1d5c49301" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.832s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-changed-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Refreshing instance network info cache due to event network-changed-3158f43d-a8c5-491d-b239-dda5a2a4b980. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] Acquiring lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] Acquired lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG nova.network.neutron [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Refreshing network info cache for port 3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG nova.network.neutron [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updated VIF entry in instance network info cache for port 3158f43d-a8c5-491d-b239-dda5a2a4b980. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG nova.network.neutron [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-36c26232-76e8-4ea1-977b-9e5742bf0a78 req-4e572f78-48df-44d3-9cc2-ed7037426b8b service nova] Releasing lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'flavor' on Instance uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:37 user nova-compute[72520]: INFO nova.compute.manager [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Attaching volume 27018497-7015-4e4c-a6f2-7a81107ff23f to /dev/vdb
Aug 02 23:55:37 user nova-compute[72520]: DEBUG os_brick.utils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832507b-e536-4de0-ab63-fb98df49cb72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e296c459-95ff-4954-befb-a4ec4dde5ac1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[16980467-b31a-47d1-900a-618e936f6f7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c40325-a4b8-45e0-9b6f-b369b8784cd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:55:37 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:55:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11010192-f47d-4959-b9b9-0d1e06fd99ab]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG os_brick.utils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:55:37 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating existing volume attachment record: 3097ff90-9a4f-4c60-9f00-485c6febac09 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:55:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:42 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020527.2664585, fb121921-3b3c-43dc-ad9a-8aa1d5c49301 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:55:42 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] VM Stopped (Lifecycle Event)
Aug 02 23:55:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-148a6b50-3284-4d19-8207-87faa52e32af None None] [instance: fb121921-3b3c-43dc-ad9a-8aa1d5c49301] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:55:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arPjpQns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:55:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:55:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:55:44 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[591772c9-cea4-4689-996c-3cf4331e9a3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:55:44 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d53b3-5eb2-4e10-8a7b-73a505d18244]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f] added
Aug 02 23:55:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df15e958-a46a-4f43-8e93-e3ebe35f7924]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c898117-8a88-43e9-95be-35f0a611e956]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arPjpQns {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arPjpQns" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ca184-74eb-44b1-9be7-e51f38244a89]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'arPjpQns'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78898095-ad24-4134-bd7d-664fd0147458]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff597b89-c965-4a5f-a2d0-2b1b0837ad59]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:55:44 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:55:44 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:55:44 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 02 23:55:44 user nova-compute[72520]: 
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b35f8d-9405-4619-95ca-8ea14e7d5f81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260]
Aug 02 23:55:44 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260] successful.
Aug 02 23:55:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f546f-7582-4cd5-b397-0fae9084ec5a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[223beecd-6f85-4d1e-8057-ba0eb4c51b9f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f (non-flash)
Aug 02 23:55:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f (non-flash)
Aug 02 23:55:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f789e26-52d2-46cf-9a9a-dedd6161df46]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:55:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arPjpQns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:55:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:55:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '23666393638623431', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:55:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666393638623431', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:55:45 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'flavor' on Instance uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:55:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:55:45 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:55:45 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:55:45 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:55:45 user nova-compute[72520]:   <serial>27018497-7015-4e4c-a6f2-7a81107ff23f</serial>
Aug 02 23:55:45 user nova-compute[72520]: </disk>
Aug 02 23:55:45 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:55:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:55:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:55:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No VIF found with MAC fa:16:3e:d5:a9:a0, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:55:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8bde71f2-790b-4b8b-9f1e-87aed8165769 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.013s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:48 user nova-compute[72520]: INFO nova.compute.manager [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Detaching volume 27018497-7015-4e4c-a6f2-7a81107ff23f
Aug 02 23:55:48 user nova-compute[72520]: INFO nova.virt.block_device [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Attempting to driver detach volume 27018497-7015-4e4c-a6f2-7a81107ff23f from mountpoint /dev/vdb
Aug 02 23:55:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Attempting to detach device vdb from instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:55:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:55:48 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:55:48 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:55:48 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:55:48 user nova-compute[72520]:   <serial>27018497-7015-4e4c-a6f2-7a81107ff23f</serial>
Aug 02 23:55:48 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:55:48 user nova-compute[72520]: </disk>
Aug 02 23:55:48 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:55:48 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully detached device vdb from instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 from the persistent domain config.
Aug 02 23:55:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:55:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:55:48 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:55:48 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:55:48 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:55:48 user nova-compute[72520]:   <serial>27018497-7015-4e4c-a6f2-7a81107ff23f</serial>
Aug 02 23:55:48 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:55:48 user nova-compute[72520]: </disk>
Aug 02 23:55:48 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020549.0298097, 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:55:49 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully detached device vdb from instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 from the live domain config.
Aug 02 23:55:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arPjpQns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:55:49 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb29bd-017d-4e94-9eb8-d9d9a899e8b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[414b3b05-5f4a-4f7f-96ad-6497d7008434]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f (non-flash)
Aug 02 23:55:49 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f (non-flash)
Aug 02 23:55:49 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4189480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.111s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b4a6c-2261-488d-96a1-457f33786169]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad549f20-0e8a-43af-b8f2-63add971a489]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78bdca1-0836-4f93-a217-a37af9ffe5c7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[716c8954-bdb0-481d-93ee-4b32c9c9da7d]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad2f8f0-7fbf-4847-8442-94a10d7be06a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2297c0-2014-4e4e-b1ed-f86351c52b7b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260]
Aug 02 23:55:49 user nova-compute[72520]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f, portal: 172.16.0.220,3260] successful.
Aug 02 23:55:49 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27018497-7015-4e4c-a6f2-7a81107ff23f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa04650b-d38d-4cc1-9e3c-3d2187377087]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] <== disconnect_volume: return (354ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:55:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'flavor' on Instance uuid d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'flavor' on Instance uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f172e247-ebb1-4745-9d6b-9d8212cd5b61 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.703s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:50 user nova-compute[72520]: INFO nova.compute.manager [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Attaching volume 3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 to /dev/vdb
Aug 02 23:55:50 user nova-compute[72520]: DEBUG os_brick.utils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dc0b40-4bb7-4163-898c-65ca3c1fa468]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8b353-7d16-4889-bc70-8a1330a13d54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c134de-826f-4b54-9830-d8e03220a3ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[52046a19-65d8-498f-a735-53a4e7cc306e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:55:50 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:55:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a6b68-7648-44db-8e93-17f6ed7fa8be]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG os_brick.utils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:55:50 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating existing volume attachment record: a0258464-4816-4d5f-8767-a5ab923e2cdf {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:55:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlAzIPnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:55:57 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:55:57 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:55:57 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a240443-0a35-4ca9-8327-36fdfae7fc94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:55:57 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc9796-9954-4294-89d0-362211d77618]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5] added
Aug 02 23:55:57 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33885630-cd82-42c8-baed-e2f4f4ff6354]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2542ab-aed0-4805-8f53-bd00259b5cb2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VlAzIPnj {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VlAzIPnj" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0403dd81-611b-4be3-aac0-8cdd4c95236f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VlAzIPnj'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a10d5c5-cb62-4c1c-bfa8-8c1fc7628454]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0240a1ea-a9cf-4307-aade-c6f8d1adfdee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:55:58 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:55:58 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:55:58 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 02 23:55:58 user nova-compute[72520]: 
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46336955-3dd2-4953-8e6a-9d702e1940fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260]
Aug 02 23:55:58 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260] successful.
Aug 02 23:55:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccda775b-433a-4986-8645-41f0e77d878f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bbd371-b3e2-4045-a82d-b431be7aa5f1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 (non-flash)
Aug 02 23:55:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 (non-flash)
Aug 02 23:55:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f211f0-9323-4321-a510-d4a5d47b73b9]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlAzIPnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:55:58 user nova-compute[72520]: INFO nova.compute.claims [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Claim successful on node user
Aug 02 23:55:58 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:55:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:55:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.policy [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7575219fc35f44bd9e10cea1089f18c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2bc015de264348a271db0a4e6a3615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:55:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Creating image(s)
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23430363564636334', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430363564636334', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'flavor' on Instance uuid d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:55:59 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:55:59 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:55:59 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:55:59 user nova-compute[72520]:   <serial>3246ec6e-bb6c-46c6-9a71-9673a5ff60a5</serial>
Aug 02 23:55:59 user nova-compute[72520]: </disk>
Aug 02 23:55:59 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk 1073741824" returned: 0 in 0.054s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Successfully created port: fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] No VIF found with MAC fa:16:3e:a6:ab:a8, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Cannot resize image /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.objects.instance [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'migration_context' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Ensure instance console log exists: /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:55:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec7ff97c-b632-46ad-8572-22bc1511af91 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.573s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Successfully updated port: fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-changed-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Refreshing instance network info cache due to event network-changed-fd871833-3bb6-4119-b904-e27a4440e86b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance network_info: |[{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.neutron [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Refreshing network info cache for port fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Start _get_guest_xml network_info=[{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:56:01 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:56:01 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.objects.instance [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'pci_devices' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:56:01 user nova-compute[72520]:   <uuid>525c1354-331d-4075-95af-df3dae596dba</uuid>
Aug 02 23:56:01 user nova-compute[72520]:   <name>instance-00000023</name>
Aug 02 23:56:01 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:56:01 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:56:01 user nova-compute[72520]:   <metadata>
Aug 02 23:56:01 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:56:01 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:56:01 user nova-compute[72520]:       <nova:name>tempest-ServerActionsTestOtherB-server-1996012707</nova:name>
Aug 02 23:56:01 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:56:01</nova:creationTime>
Aug 02 23:56:01 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:56:01 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:56:01 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:56:01 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:56:01 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:56:01 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:56:01 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:56:01 user nova-compute[72520]:       <nova:owner>
Aug 02 23:56:01 user nova-compute[72520]:         <nova:user uuid="7575219fc35f44bd9e10cea1089f18c4">tempest-ServerActionsTestOtherB-1849233865-project-member</nova:user>
Aug 02 23:56:01 user nova-compute[72520]:         <nova:project uuid="2d2bc015de264348a271db0a4e6a3615">tempest-ServerActionsTestOtherB-1849233865</nova:project>
Aug 02 23:56:01 user nova-compute[72520]:       </nova:owner>
Aug 02 23:56:01 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:56:01 user nova-compute[72520]:       <nova:ports>
Aug 02 23:56:01 user nova-compute[72520]:         <nova:port uuid="fd871833-3bb6-4119-b904-e27a4440e86b">
Aug 02 23:56:01 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 02 23:56:01 user nova-compute[72520]:         </nova:port>
Aug 02 23:56:01 user nova-compute[72520]:       </nova:ports>
Aug 02 23:56:01 user nova-compute[72520]:     </nova:instance>
Aug 02 23:56:01 user nova-compute[72520]:   </metadata>
Aug 02 23:56:01 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:56:01 user nova-compute[72520]:     <system>
Aug 02 23:56:01 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:56:01 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:56:01 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:56:01 user nova-compute[72520]:       <entry name="serial">525c1354-331d-4075-95af-df3dae596dba</entry>
Aug 02 23:56:01 user nova-compute[72520]:       <entry name="uuid">525c1354-331d-4075-95af-df3dae596dba</entry>
Aug 02 23:56:01 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:56:01 user nova-compute[72520]:     </system>
Aug 02 23:56:01 user nova-compute[72520]:   </sysinfo>
Aug 02 23:56:01 user nova-compute[72520]:   <os>
Aug 02 23:56:01 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:56:01 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:56:01 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:56:01 user nova-compute[72520]:   </os>
Aug 02 23:56:01 user nova-compute[72520]:   <features>
Aug 02 23:56:01 user nova-compute[72520]:     <acpi/>
Aug 02 23:56:01 user nova-compute[72520]:     <apic/>
Aug 02 23:56:01 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:56:01 user nova-compute[72520]:   </features>
Aug 02 23:56:01 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:56:01 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:56:01 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:56:01 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:56:01 user nova-compute[72520]:   </clock>
Aug 02 23:56:01 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:56:01 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:56:01 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:56:01 user nova-compute[72520]:   </cpu>
Aug 02 23:56:01 user nova-compute[72520]:   <devices>
Aug 02 23:56:01 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:56:01 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:56:01 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk"/>
Aug 02 23:56:01 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:56:01 user nova-compute[72520]:     </disk>
Aug 02 23:56:01 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:56:01 user nova-compute[72520]:       <mac address="fa:16:3e:06:61:f1"/>
Aug 02 23:56:01 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:56:01 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:56:01 user nova-compute[72520]:       <target dev="tapfd871833-3b"/>
Aug 02 23:56:01 user nova-compute[72520]:     </interface>
Aug 02 23:56:01 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:56:01 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/console.log" append="off"/>
Aug 02 23:56:01 user nova-compute[72520]:     </serial>
Aug 02 23:56:01 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:56:01 user nova-compute[72520]:     <video>
Aug 02 23:56:01 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:56:01 user nova-compute[72520]:     </video>
Aug 02 23:56:01 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:56:01 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:56:01 user nova-compute[72520]:     </rng>
Aug 02 23:56:01 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:56:01 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:56:01 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:56:01 user nova-compute[72520]:     </memballoon>
Aug 02 23:56:01 user nova-compute[72520]:   </devices>
Aug 02 23:56:01 user nova-compute[72520]: </domain>
Aug 02 23:56:01 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG os_vif [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd871833-3b, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd871833-3b, col_values=(('external_ids', {'iface-id': 'fd871833-3bb6-4119-b904-e27a4440e86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:61:f1', 'vm-uuid': '525c1354-331d-4075-95af-df3dae596dba'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:01 user nova-compute[72520]: INFO os_vif [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b')
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No VIF found with MAC fa:16:3e:06:61:f1, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.neutron [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updated VIF entry in instance network info cache for port fd871833-3bb6-4119-b904-e27a4440e86b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.neutron [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4629cf89-a6cd-4878-b549-db109977c796 req-a230c4cf-0a85-4255-b1f0-9c348c1b6b23 service nova] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Skipping network cache update for instance because it is Building. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:56:01 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 0e13bfd1-68d9-442a-b95b-40caaa10586c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updating instance_info_cache with network_info: [{"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0e13bfd1-68d9-442a-b95b-40caaa10586c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-3197cff8-e1cc-4c54-9e98-30f846cebb67 req-336521e6-88ee-43fa-b375-540eb163fb5d service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3197cff8-e1cc-4c54-9e98-30f846cebb67 req-336521e6-88ee-43fa-b375-540eb163fb5d service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3197cff8-e1cc-4c54-9e98-30f846cebb67 req-336521e6-88ee-43fa-b375-540eb163fb5d service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3197cff8-e1cc-4c54-9e98-30f846cebb67 req-336521e6-88ee-43fa-b375-540eb163fb5d service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-3197cff8-e1cc-4c54-9e98-30f846cebb67 req-336521e6-88ee-43fa-b375-540eb163fb5d service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:02 user nova-compute[72520]: WARNING nova.compute.manager [req-3197cff8-e1cc-4c54-9e98-30f846cebb67 req-336521e6-88ee-43fa-b375-540eb163fb5d service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state building and task_state spawning.
Aug 02 23:56:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020564.591541, 525c1354-331d-4075-95af-df3dae596dba => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Resumed (Lifecycle Event)
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:56:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance spawned successfully.
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020564.5946329, 525c1354-331d-4075-95af-df3dae596dba => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Started (Lifecycle Event)
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:56:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:56:04 user nova-compute[72520]: INFO nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 02 23:56:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:04 user nova-compute[72520]: INFO nova.compute.manager [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Took 6.24 seconds to build instance.
Aug 02 23:56:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e77f348c-ad83-465d-98d3-dd322d581e5e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.341s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing instance network info cache due to event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing instance network info cache due to event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updated VIF entry in instance network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:05 user nova-compute[72520]: INFO nova.compute.manager [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Rebooting instance
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5ab8b05a-aae6-48e3-a360-88553c19b0dd req-9e939239-5d46-413e-9525-a59fe4c69b09 service nova] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:56:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updated VIF entry in instance network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG nova.network.neutron [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:06 user nova-compute[72520]: WARNING nova.compute.manager [req-b8c012d1-f1c9-4bc7-b358-88a84d1b6190 req-f5739495-d5dc-49aa-8265-ad102d372a6f service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state active and task_state None.
Aug 02 23:56:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-1f9868b2-647b-4e47-b2df-8a332daa875a req-800eaeed-0760-4c87-a970-168c8862be7b service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-unplugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1f9868b2-647b-4e47-b2df-8a332daa875a req-800eaeed-0760-4c87-a970-168c8862be7b service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1f9868b2-647b-4e47-b2df-8a332daa875a req-800eaeed-0760-4c87-a970-168c8862be7b service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1f9868b2-647b-4e47-b2df-8a332daa875a req-800eaeed-0760-4c87-a970-168c8862be7b service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-1f9868b2-647b-4e47-b2df-8a332daa875a req-800eaeed-0760-4c87-a970-168c8862be7b service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-unplugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:09 user nova-compute[72520]: WARNING nova.compute.manager [req-1f9868b2-647b-4e47-b2df-8a332daa875a req-800eaeed-0760-4c87-a970-168c8862be7b service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received unexpected event network-vif-unplugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with vm_state active and task_state reboot_started.
Aug 02 23:56:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:09 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:56:09 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=25.255237579345703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0e13bfd1-68d9-442a-b95b-40caaa10586c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d8b74c7b-117b-4f86-a593-d767e6def722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:56:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance shutdown successfully.
Aug 02 23:56:09 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:56:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:56:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:56:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-33eabf48-31cf-40ae-8923-794a8ca1e224 req-cb156fc9-c176-4a5c-830b-30f1ebf1b654 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33eabf48-31cf-40ae-8923-794a8ca1e224 req-cb156fc9-c176-4a5c-830b-30f1ebf1b654 service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33eabf48-31cf-40ae-8923-794a8ca1e224 req-cb156fc9-c176-4a5c-830b-30f1ebf1b654 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33eabf48-31cf-40ae-8923-794a8ca1e224 req-cb156fc9-c176-4a5c-830b-30f1ebf1b654 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-33eabf48-31cf-40ae-8923-794a8ca1e224 req-cb156fc9-c176-4a5c-830b-30f1ebf1b654 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:11 user nova-compute[72520]: WARNING nova.compute.manager [req-33eabf48-31cf-40ae-8923-794a8ca1e224 req-cb156fc9-c176-4a5c-830b-30f1ebf1b654 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received unexpected event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with vm_state active and task_state reboot_started.
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Removed pending event for d8b74c7b-117b-4f86-a593-d767e6def722 due to event {{(pid=72520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020573.26048, d8b74c7b-117b-4f86-a593-d767e6def722 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:13 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] VM Resumed (Lifecycle Event)
Aug 02 23:56:13 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance running successfully.
Aug 02 23:56:13 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance soft rebooted successfully.
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:13 user nova-compute[72520]: WARNING nova.compute.manager [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received unexpected event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with vm_state active and task_state reboot_started.
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:13 user nova-compute[72520]: WARNING nova.compute.manager [req-c601edb8-fc0b-4c0b-a5f3-3ae2b40abb71 req-fb96f216-c839-414b-8a67-7493f855949f service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received unexpected event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with vm_state active and task_state reboot_started.
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:56:13 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020573.2607083, d8b74c7b-117b-4f86-a593-d767e6def722 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:13 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] VM Started (Lifecycle Event)
Aug 02 23:56:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9a078aa5-8ed4-4d6c-8953-30aab61b13b8 tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.594s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:56:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:17 user nova-compute[72520]: INFO nova.compute.manager [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Terminating instance
Aug 02 23:56:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-0beb58bf-7e69-443a-9f1d-742103a98ad4 req-3a4c9ce2-6d8e-42b8-b86e-eaab90f8e5a0 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-unplugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0beb58bf-7e69-443a-9f1d-742103a98ad4 req-3a4c9ce2-6d8e-42b8-b86e-eaab90f8e5a0 service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0beb58bf-7e69-443a-9f1d-742103a98ad4 req-3a4c9ce2-6d8e-42b8-b86e-eaab90f8e5a0 service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0beb58bf-7e69-443a-9f1d-742103a98ad4 req-3a4c9ce2-6d8e-42b8-b86e-eaab90f8e5a0 service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-0beb58bf-7e69-443a-9f1d-742103a98ad4 req-3a4c9ce2-6d8e-42b8-b86e-eaab90f8e5a0 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-unplugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-0beb58bf-7e69-443a-9f1d-742103a98ad4 req-3a4c9ce2-6d8e-42b8-b86e-eaab90f8e5a0 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-unplugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Instance destroyed successfully.
Aug 02 23:56:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lazy-loading 'resources' on Instance uuid 0e13bfd1-68d9-442a-b95b-40caaa10586c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-589631707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-589631707',id=18,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542e5ab2d59245f58d357cf688e30a43',ramdisk_id='',reservation_id='r-du80d9d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:38:35Z,user_data=None,user_id='f3ecb56ac3554ee3b1ef658d9cdd3869',uuid=0e13bfd1-68d9-442a-b95b-40caaa10586c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converting VIF {"id": "45376fd7-ad38-407d-8b13-3843586a4e63", "address": "fa:16:3e:81:91:59", "network": {"id": "6caa053e-12f7-403a-b275-f3dc4213cecc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697886145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542e5ab2d59245f58d357cf688e30a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45376fd7-ad", "ovs_interfaceid": "45376fd7-ad38-407d-8b13-3843586a4e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:91:59,bridge_name='br-int',has_traffic_filtering=True,id=45376fd7-ad38-407d-8b13-3843586a4e63,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45376fd7-ad') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG os_vif [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:91:59,bridge_name='br-int',has_traffic_filtering=True,id=45376fd7-ad38-407d-8b13-3843586a4e63,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45376fd7-ad') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45376fd7-ad, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:56:18 user nova-compute[72520]: INFO os_vif [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:91:59,bridge_name='br-int',has_traffic_filtering=True,id=45376fd7-ad38-407d-8b13-3843586a4e63,network=Network(6caa053e-12f7-403a-b275-f3dc4213cecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45376fd7-ad')
Aug 02 23:56:18 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Deleting instance files /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c_del
Aug 02 23:56:18 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Deletion of /opt/stack/data/nova/instances/0e13bfd1-68d9-442a-b95b-40caaa10586c_del complete
Aug 02 23:56:18 user nova-compute[72520]: INFO nova.compute.manager [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 02 23:56:18 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:19 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Took 0.72 seconds to deallocate network for instance.
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-d125bf42-3c29-4eb6-9217-462a43a23079 req-6b7e6db6-b045-4850-827e-c3e33d80de12 service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-deleted-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:19 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Deleted allocations for instance 0e13bfd1-68d9-442a-b95b-40caaa10586c
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c477b29-1412-4b92-a8a7-dfc47541047c tempest-ServerBootFromVolumeStableRescueTest-1108272558 tempest-ServerBootFromVolumeStableRescueTest-1108272558-project-member] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:19 user nova-compute[72520]: WARNING nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received unexpected event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with vm_state deleted and task_state None.
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:19 user nova-compute[72520]: WARNING nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received unexpected event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with vm_state deleted and task_state None.
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:19 user nova-compute[72520]: WARNING nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received unexpected event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with vm_state deleted and task_state None.
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-unplugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-unplugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:19 user nova-compute[72520]: WARNING nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received unexpected event network-vif-unplugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with vm_state deleted and task_state None.
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Acquiring lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] Lock "0e13bfd1-68d9-442a-b95b-40caaa10586c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:19 user nova-compute[72520]: DEBUG nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] No waiting events found dispatching network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:19 user nova-compute[72520]: WARNING nova.compute.manager [req-e641fde6-bded-4c52-8399-961b4e7fd625 req-48cdb895-5959-42bf-be34-973f937cbb1d service nova] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Received unexpected event network-vif-plugged-45376fd7-ad38-407d-8b13-3843586a4e63 for instance with vm_state deleted and task_state None.
Aug 02 23:56:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:29 user nova-compute[72520]: DEBUG nova.compute.manager [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing instance network info cache due to event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:56:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:29 user nova-compute[72520]: DEBUG nova.network.neutron [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:56:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updated VIF entry in instance network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:56:30 user nova-compute[72520]: DEBUG nova.network.neutron [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f1324c66-69ea-42ee-aa59-78426cd0b955 req-e0aaa5d8-99cc-438d-b49d-2053731fb806 service nova] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:33 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020578.15433, 0e13bfd1-68d9-442a-b95b-40caaa10586c => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:33 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] VM Stopped (Lifecycle Event)
Aug 02 23:56:33 user nova-compute[72520]: DEBUG nova.compute.manager [None req-bdf1aec9-5f72-4e0a-ab85-6e77e8881b3c None None] [instance: 0e13bfd1-68d9-442a-b95b-40caaa10586c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:34 user nova-compute[72520]: INFO nova.compute.manager [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Shelving
Aug 02 23:56:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-8105dcf5-6782-449e-9fad-8421aa108b55 req-b61f8ffb-00b8-49ed-8ba8-63e168d7e6a2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-unplugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8105dcf5-6782-449e-9fad-8421aa108b55 req-b61f8ffb-00b8-49ed-8ba8-63e168d7e6a2 service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8105dcf5-6782-449e-9fad-8421aa108b55 req-b61f8ffb-00b8-49ed-8ba8-63e168d7e6a2 service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8105dcf5-6782-449e-9fad-8421aa108b55 req-b61f8ffb-00b8-49ed-8ba8-63e168d7e6a2 service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-8105dcf5-6782-449e-9fad-8421aa108b55 req-b61f8ffb-00b8-49ed-8ba8-63e168d7e6a2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-unplugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:34 user nova-compute[72520]: WARNING nova.compute.manager [req-8105dcf5-6782-449e-9fad-8421aa108b55 req-b61f8ffb-00b8-49ed-8ba8-63e168d7e6a2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received unexpected event network-vif-unplugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with vm_state active and task_state shelving.
Aug 02 23:56:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance destroyed successfully.
Aug 02 23:56:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Beginning cold snapshot process
Aug 02 23:56:35 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:56:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk /opt/stack/data/nova/instances/snapshots/tmpe35e0n8m/97490652dba9468abbb8a1991c39873f {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk /opt/stack/data/nova/instances/snapshots/tmpe35e0n8m/97490652dba9468abbb8a1991c39873f" returned: 0 in 0.495s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Snapshot extracted, beginning image upload
Aug 02 23:56:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-475623b2-928a-491d-b6dc-d60a47eea148 req-ba4527c0-9ecb-4979-93c3-717162784aad service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-475623b2-928a-491d-b6dc-d60a47eea148 req-ba4527c0-9ecb-4979-93c3-717162784aad service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-475623b2-928a-491d-b6dc-d60a47eea148 req-ba4527c0-9ecb-4979-93c3-717162784aad service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-475623b2-928a-491d-b6dc-d60a47eea148 req-ba4527c0-9ecb-4979-93c3-717162784aad service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-475623b2-928a-491d-b6dc-d60a47eea148 req-ba4527c0-9ecb-4979-93c3-717162784aad service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:36 user nova-compute[72520]: WARNING nova.compute.manager [req-475623b2-928a-491d-b6dc-d60a47eea148 req-ba4527c0-9ecb-4979-93c3-717162784aad service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received unexpected event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with vm_state active and task_state shelving_image_uploading.
Aug 02 23:56:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Snapshot image upload complete
Aug 02 23:56:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:38 user nova-compute[72520]: INFO nova.compute.manager [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Shelve offloading
Aug 02 23:56:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance destroyed successfully.
Aug 02 23:56:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:56:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance destroyed successfully.
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'resources' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1538732641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1538732641',id=34,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaQd+V9/52J/QBVoJW+fu0jc4kF0cPPPSztdB4k+LP+O+3cZpKkqQ5qYL8SzbR8hSWHhqV0zC/blRoXw0fsZks6XShfvKnjJSjMzqg8by6uOc80nv5oxz4bni5jbYZvA==',key_name='tempest-keypair-641100772',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:54:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-4ofkuknn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member',shelved_at='2023-08-02T23:56:38.259985',shelved_host='user',shelved_image_id='a2fbc699-b01a-4f08-b926-9e590cdfdffa'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=4b47e71c-4d43-4727-97ac-a47ff88b6c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG os_vif [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb2a1afa-6a, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing instance network info cache due to event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:56:39 user nova-compute[72520]: INFO os_vif [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a')
Aug 02 23:56:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Deleting instance files /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c_del
Aug 02 23:56:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Deletion of /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c_del complete
Aug 02 23:56:39 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Deleted allocations for instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c
Aug 02 23:56:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:56:40 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:56:40 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:56:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updated VIF entry in instance network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:56:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1d88f133-6e39-44ae-a684-6f3dd13d2c25 req-4f0cdf34-8920-49c4-8934-64cbe97d6070 service nova] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6e50ab5a-9559-437b-b63a-0a31257544df tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.549s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:44 user nova-compute[72520]: INFO nova.compute.manager [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] instance snapshotting
Aug 02 23:56:45 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Beginning live snapshot process
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json -f qcow2 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json -f qcow2" returned: 0 in 0.129s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8t5tr3cy/70d8bd47c53b41918c7cdae9416ffe2d.delta 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8t5tr3cy/70d8bd47c53b41918c7cdae9416ffe2d.delta 1073741824" returned: 0 in 0.047s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:45 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 02 23:56:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:56:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 02 23:56:46 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 02 23:56:46 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:56:46 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8t5tr3cy/70d8bd47c53b41918c7cdae9416ffe2d.delta /opt/stack/data/nova/instances/snapshots/tmp8t5tr3cy/70d8bd47c53b41918c7cdae9416ffe2d {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8t5tr3cy/70d8bd47c53b41918c7cdae9416ffe2d.delta /opt/stack/data/nova/instances/snapshots/tmp8t5tr3cy/70d8bd47c53b41918c7cdae9416ffe2d" returned: 0 in 0.350s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Snapshot extracted, beginning image upload
Aug 02 23:56:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:49 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Snapshot image upload complete
Aug 02 23:56:49 user nova-compute[72520]: INFO nova.compute.manager [None req-9689da9f-27f1-4363-98d1-f32b036ed0f4 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Took 4.68 seconds to snapshot the instance on the hypervisor.
Aug 02 23:56:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:50 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020595.4604356, 4b47e71c-4d43-4727-97ac-a47ff88b6c2c => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:50 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] VM Stopped (Lifecycle Event)
Aug 02 23:56:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-a25ba6ad-a8d4-4b9c-b632-411d6f7be7ea None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:56:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:51 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:56:51 user nova-compute[72520]: INFO nova.compute.claims [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Claim successful on node user
Aug 02 23:56:51 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:56:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:56:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:56:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG nova.policy [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '333b602f3a894e4e84db31594de293c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c4d33b6caa44d6945a836e0b19ba10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:56:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Creating image(s)
Aug 02 23:56:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "/opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "/opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "/opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "f875e026f32a1a050e7279a9ec4b68d067486879" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "f875e026f32a1a050e7279a9ec4b68d067486879" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Successfully created port: 7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.part --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG nova.virt.images [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] a18fa303-a30b-448a-a9eb-6d6e5372ae75 was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.part /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.part /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.converted" returned: 0 in 0.289s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "f875e026f32a1a050e7279a9ec4b68d067486879" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.301s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879 --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "f875e026f32a1a050e7279a9ec4b68d067486879" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "f875e026f32a1a050e7279a9ec4b68d067486879" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879 --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879,backing_fmt=raw /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Successfully updated port: 7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-changed-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Refreshing instance network info cache due to event network-changed-7adff173-4541-4202-901d-d07f843f301b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] Acquiring lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] Acquired lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Refreshing network info cache for port 7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879,backing_fmt=raw /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk 1073741824" returned: 0 in 0.065s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "f875e026f32a1a050e7279a9ec4b68d067486879" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:56:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879 --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'migration_context' on Instance uuid 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Ensure instance console log exists: /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6169999d-bc9a-494a-a489-3e934fa4b144 req-8ef1f9b4-20e6-4282-a32c-f1e593af32c9 service nova] Releasing lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquired lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updating instance_info_cache with network_info: [{"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Releasing lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Instance network_info: |[{"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Start _get_guest_xml network_info=[{"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e1ad9db4a4fd9dd5cd5999868a6e22a0',container_format='bare',created_at=2023-08-02T23:56:45Z,direct_url=<?>,disk_format='qcow2',id=a18fa303-a30b-448a-a9eb-6d6e5372ae75,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-99006866',owner='f0c4d33b6caa44d6945a836e0b19ba10',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-02T23:56:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'a18fa303-a30b-448a-a9eb-6d6e5372ae75'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:56:54 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:56:54 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e1ad9db4a4fd9dd5cd5999868a6e22a0',container_format='bare',created_at=2023-08-02T23:56:45Z,direct_url=<?>,disk_format='qcow2',id=a18fa303-a30b-448a-a9eb-6d6e5372ae75,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-99006866',owner='f0c4d33b6caa44d6945a836e0b19ba10',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-02T23:56:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-593316272',display_name='tempest-TestStampPattern-server-593316272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-593316272',id=36,image_ref='a18fa303-a30b-448a-a9eb-6d6e5372ae75',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfr+fZTq73vPqi3KD8xg6zCQNhY3yvgp2jBtELhyFONrVCY4fZPONJM5IwmbDaDaDReMtv/cCmZk6EIIRiMsEWdetIL8IFplnshiRssnbg415aZgohbu0Rd9qgWXAMv6g==',key_name='tempest-TestStampPattern-2115296246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0c4d33b6caa44d6945a836e0b19ba10',ramdisk_id='',reservation_id='r-zio5e235',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0fa3db91-fd75-47e6-bce0-f612e5afe5c0',image_min_disk='1',image_min_ram='0',image_owner_id='f0c4d33b6caa44d6945a836e0b19ba10',image_owner_project_name='tempest-TestStampPattern-163390428',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-163390428-project-member',image_user_id='333b602f3a894e4e84db31594de293c7',network_allocated='True',owner_project_name='tempest-TestStampPattern-163390428',owner_user_name='tempest-TestStampPattern-163390428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:56:52Z,user_data=None,user_id='333b602f3a894e4e84db31594de293c7',uuid=7373c6f3-5a7b-4b9a-a8cd-0ea478932321,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converting VIF {"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:e3,bridge_name='br-int',has_traffic_filtering=True,id=7adff173-4541-4202-901d-d07f843f301b,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adff173-45') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'pci_devices' on Instance uuid 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:56:54 user nova-compute[72520]:   <uuid>7373c6f3-5a7b-4b9a-a8cd-0ea478932321</uuid>
Aug 02 23:56:54 user nova-compute[72520]:   <name>instance-00000024</name>
Aug 02 23:56:54 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:56:54 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:56:54 user nova-compute[72520]:   <metadata>
Aug 02 23:56:54 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:56:54 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:56:54 user nova-compute[72520]:       <nova:name>tempest-TestStampPattern-server-593316272</nova:name>
Aug 02 23:56:54 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:56:54</nova:creationTime>
Aug 02 23:56:54 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:56:54 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:56:54 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:56:54 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:56:54 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:56:54 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:56:54 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:56:54 user nova-compute[72520]:       <nova:owner>
Aug 02 23:56:54 user nova-compute[72520]:         <nova:user uuid="333b602f3a894e4e84db31594de293c7">tempest-TestStampPattern-163390428-project-member</nova:user>
Aug 02 23:56:54 user nova-compute[72520]:         <nova:project uuid="f0c4d33b6caa44d6945a836e0b19ba10">tempest-TestStampPattern-163390428</nova:project>
Aug 02 23:56:54 user nova-compute[72520]:       </nova:owner>
Aug 02 23:56:54 user nova-compute[72520]:       <nova:root type="image" uuid="a18fa303-a30b-448a-a9eb-6d6e5372ae75"/>
Aug 02 23:56:54 user nova-compute[72520]:       <nova:ports>
Aug 02 23:56:54 user nova-compute[72520]:         <nova:port uuid="7adff173-4541-4202-901d-d07f843f301b">
Aug 02 23:56:54 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 02 23:56:54 user nova-compute[72520]:         </nova:port>
Aug 02 23:56:54 user nova-compute[72520]:       </nova:ports>
Aug 02 23:56:54 user nova-compute[72520]:     </nova:instance>
Aug 02 23:56:54 user nova-compute[72520]:   </metadata>
Aug 02 23:56:54 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:56:54 user nova-compute[72520]:     <system>
Aug 02 23:56:54 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:56:54 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:56:54 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:56:54 user nova-compute[72520]:       <entry name="serial">7373c6f3-5a7b-4b9a-a8cd-0ea478932321</entry>
Aug 02 23:56:54 user nova-compute[72520]:       <entry name="uuid">7373c6f3-5a7b-4b9a-a8cd-0ea478932321</entry>
Aug 02 23:56:54 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:56:54 user nova-compute[72520]:     </system>
Aug 02 23:56:54 user nova-compute[72520]:   </sysinfo>
Aug 02 23:56:54 user nova-compute[72520]:   <os>
Aug 02 23:56:54 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:56:54 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:56:54 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:56:54 user nova-compute[72520]:   </os>
Aug 02 23:56:54 user nova-compute[72520]:   <features>
Aug 02 23:56:54 user nova-compute[72520]:     <acpi/>
Aug 02 23:56:54 user nova-compute[72520]:     <apic/>
Aug 02 23:56:54 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:56:54 user nova-compute[72520]:   </features>
Aug 02 23:56:54 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:56:54 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:56:54 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:56:54 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:56:54 user nova-compute[72520]:   </clock>
Aug 02 23:56:54 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:56:54 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:56:54 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:56:54 user nova-compute[72520]:   </cpu>
Aug 02 23:56:54 user nova-compute[72520]:   <devices>
Aug 02 23:56:54 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:56:54 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:56:54 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk"/>
Aug 02 23:56:54 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:56:54 user nova-compute[72520]:     </disk>
Aug 02 23:56:54 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:56:54 user nova-compute[72520]:       <mac address="fa:16:3e:04:f5:e3"/>
Aug 02 23:56:54 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:56:54 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:56:54 user nova-compute[72520]:       <target dev="tap7adff173-45"/>
Aug 02 23:56:54 user nova-compute[72520]:     </interface>
Aug 02 23:56:54 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:56:54 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/console.log" append="off"/>
Aug 02 23:56:54 user nova-compute[72520]:     </serial>
Aug 02 23:56:54 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:56:54 user nova-compute[72520]:     <video>
Aug 02 23:56:54 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:56:54 user nova-compute[72520]:     </video>
Aug 02 23:56:54 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:56:54 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:56:54 user nova-compute[72520]:     </rng>
Aug 02 23:56:54 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:56:54 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:56:54 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:56:54 user nova-compute[72520]:     </memballoon>
Aug 02 23:56:54 user nova-compute[72520]:   </devices>
Aug 02 23:56:54 user nova-compute[72520]: </domain>
Aug 02 23:56:54 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-593316272',display_name='tempest-TestStampPattern-server-593316272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-593316272',id=36,image_ref='a18fa303-a30b-448a-a9eb-6d6e5372ae75',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfr+fZTq73vPqi3KD8xg6zCQNhY3yvgp2jBtELhyFONrVCY4fZPONJM5IwmbDaDaDReMtv/cCmZk6EIIRiMsEWdetIL8IFplnshiRssnbg415aZgohbu0Rd9qgWXAMv6g==',key_name='tempest-TestStampPattern-2115296246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0c4d33b6caa44d6945a836e0b19ba10',ramdisk_id='',reservation_id='r-zio5e235',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0fa3db91-fd75-47e6-bce0-f612e5afe5c0',image_min_disk='1',image_min_ram='0',image_owner_id='f0c4d33b6caa44d6945a836e0b19ba10',image_owner_project_name='tempest-TestStampPattern-163390428',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-163390428-project-member',image_user_id='333b602f3a894e4e84db31594de293c7',network_allocated='True',owner_project_name='tempest-TestStampPattern-163390428',owner_user_name='tempest-TestStampPattern-163390428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:56:52Z,user_data=None,user_id='333b602f3a894e4e84db31594de293c7',uuid=7373c6f3-5a7b-4b9a-a8cd-0ea478932321,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converting VIF {"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:e3,bridge_name='br-int',has_traffic_filtering=True,id=7adff173-4541-4202-901d-d07f843f301b,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adff173-45') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG os_vif [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:e3,bridge_name='br-int',has_traffic_filtering=True,id=7adff173-4541-4202-901d-d07f843f301b,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adff173-45') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7adff173-45, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7adff173-45, col_values=(('external_ids', {'iface-id': '7adff173-4541-4202-901d-d07f843f301b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f5:e3', 'vm-uuid': '7373c6f3-5a7b-4b9a-a8cd-0ea478932321'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:54 user nova-compute[72520]: INFO os_vif [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:e3,bridge_name='br-int',has_traffic_filtering=True,id=7adff173-4541-4202-901d-d07f843f301b,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adff173-45')
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:56:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No VIF found with MAC fa:16:3e:04:f5:e3, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-d472d463-c2c3-4da7-b60b-04ff3f073d45 req-46ff2612-d959-4567-83a9-bfa8d5a4c663 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d472d463-c2c3-4da7-b60b-04ff3f073d45 req-46ff2612-d959-4567-83a9-bfa8d5a4c663 service nova] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d472d463-c2c3-4da7-b60b-04ff3f073d45 req-46ff2612-d959-4567-83a9-bfa8d5a4c663 service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d472d463-c2c3-4da7-b60b-04ff3f073d45 req-46ff2612-d959-4567-83a9-bfa8d5a4c663 service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-d472d463-c2c3-4da7-b60b-04ff3f073d45 req-46ff2612-d959-4567-83a9-bfa8d5a4c663 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] No waiting events found dispatching network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:56 user nova-compute[72520]: WARNING nova.compute.manager [req-d472d463-c2c3-4da7-b60b-04ff3f073d45 req-46ff2612-d959-4567-83a9-bfa8d5a4c663 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received unexpected event network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b for instance with vm_state building and task_state spawning.
Aug 02 23:56:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020618.2548885, 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] VM Resumed (Lifecycle Event)
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:56:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Instance spawned successfully.
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:56:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020618.2561092, 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:56:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] VM Started (Lifecycle Event)
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:58 user nova-compute[72520]: INFO nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-ae5a0c2c-402d-43df-80ba-25d9a1601c3c req-ba634d6c-1c87-4fb8-a402-fa46e5e0eb5b service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae5a0c2c-402d-43df-80ba-25d9a1601c3c req-ba634d6c-1c87-4fb8-a402-fa46e5e0eb5b service nova] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae5a0c2c-402d-43df-80ba-25d9a1601c3c req-ba634d6c-1c87-4fb8-a402-fa46e5e0eb5b service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae5a0c2c-402d-43df-80ba-25d9a1601c3c req-ba634d6c-1c87-4fb8-a402-fa46e5e0eb5b service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-ae5a0c2c-402d-43df-80ba-25d9a1601c3c req-ba634d6c-1c87-4fb8-a402-fa46e5e0eb5b service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] No waiting events found dispatching network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:56:58 user nova-compute[72520]: WARNING nova.compute.manager [req-ae5a0c2c-402d-43df-80ba-25d9a1601c3c req-ba634d6c-1c87-4fb8-a402-fa46e5e0eb5b service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received unexpected event network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b for instance with vm_state building and task_state spawning.
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 02 23:56:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:56:58 user nova-compute[72520]: INFO nova.compute.manager [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Took 6.73 seconds to build instance.
Aug 02 23:56:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c49f57af-dedb-4cd6-bab5-db05e7c06d1e tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.824s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:56:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:56:59 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:56:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:56:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:56:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:56:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:56:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:57:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:57:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:57:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:06 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:06 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:57:07 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:57:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:57:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:57:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=25.185359954833984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d8b74c7b-117b-4f86-a593-d767e6def722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:57:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 02 23:57:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 02 23:57:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:57:21 user nova-compute[72520]: INFO nova.compute.claims [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Claim successful on node user
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 02 23:57:21 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.policy [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ce27b8383604c46ab82b2af76c7e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4088b685db6408fa8b3231fa95405e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:57:21 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Creating image(s)
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk 1073741824" returned: 0 in 0.050s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Successfully created port: 571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Cannot resize image /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'migration_context' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Ensure instance console log exists: /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Successfully updated port: 571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquired lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-changed-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Refreshing instance network info cache due to event network-changed-571c58f6-401f-4632-916d-646803b6f25f. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] Acquiring lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Releasing lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance network_info: |[{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] Acquired lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Refreshing network info cache for port 571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Start _get_guest_xml network_info=[{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:57:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:57:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:57:23 user nova-compute[72520]:   <uuid>0ada24d4-91f7-4d2f-bd25-6c226d313331</uuid>
Aug 02 23:57:23 user nova-compute[72520]:   <name>instance-00000025</name>
Aug 02 23:57:23 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:57:23 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:57:23 user nova-compute[72520]:   <metadata>
Aug 02 23:57:23 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:57:23 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:57:23 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeTestJSON-server-548410330</nova:name>
Aug 02 23:57:23 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:57:23</nova:creationTime>
Aug 02 23:57:23 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:57:23 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:57:23 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:57:23 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:57:23 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:57:23 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:57:23 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:57:23 user nova-compute[72520]:       <nova:owner>
Aug 02 23:57:23 user nova-compute[72520]:         <nova:user uuid="7ce27b8383604c46ab82b2af76c7e26b">tempest-AttachVolumeTestJSON-2114655012-project-member</nova:user>
Aug 02 23:57:23 user nova-compute[72520]:         <nova:project uuid="e4088b685db6408fa8b3231fa95405e7">tempest-AttachVolumeTestJSON-2114655012</nova:project>
Aug 02 23:57:23 user nova-compute[72520]:       </nova:owner>
Aug 02 23:57:23 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 02 23:57:23 user nova-compute[72520]:       <nova:ports>
Aug 02 23:57:23 user nova-compute[72520]:         <nova:port uuid="571c58f6-401f-4632-916d-646803b6f25f">
Aug 02 23:57:23 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 02 23:57:23 user nova-compute[72520]:         </nova:port>
Aug 02 23:57:23 user nova-compute[72520]:       </nova:ports>
Aug 02 23:57:23 user nova-compute[72520]:     </nova:instance>
Aug 02 23:57:23 user nova-compute[72520]:   </metadata>
Aug 02 23:57:23 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:57:23 user nova-compute[72520]:     <system>
Aug 02 23:57:23 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:57:23 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:57:23 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:57:23 user nova-compute[72520]:       <entry name="serial">0ada24d4-91f7-4d2f-bd25-6c226d313331</entry>
Aug 02 23:57:23 user nova-compute[72520]:       <entry name="uuid">0ada24d4-91f7-4d2f-bd25-6c226d313331</entry>
Aug 02 23:57:23 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:57:23 user nova-compute[72520]:     </system>
Aug 02 23:57:23 user nova-compute[72520]:   </sysinfo>
Aug 02 23:57:23 user nova-compute[72520]:   <os>
Aug 02 23:57:23 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:57:23 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:57:23 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:57:23 user nova-compute[72520]:   </os>
Aug 02 23:57:23 user nova-compute[72520]:   <features>
Aug 02 23:57:23 user nova-compute[72520]:     <acpi/>
Aug 02 23:57:23 user nova-compute[72520]:     <apic/>
Aug 02 23:57:23 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:57:23 user nova-compute[72520]:   </features>
Aug 02 23:57:23 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:57:23 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:57:23 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:57:23 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:57:23 user nova-compute[72520]:   </clock>
Aug 02 23:57:23 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:57:23 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:57:23 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:57:23 user nova-compute[72520]:   </cpu>
Aug 02 23:57:23 user nova-compute[72520]:   <devices>
Aug 02 23:57:23 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:57:23 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:57:23 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk"/>
Aug 02 23:57:23 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:57:23 user nova-compute[72520]:     </disk>
Aug 02 23:57:23 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:57:23 user nova-compute[72520]:       <mac address="fa:16:3e:8a:9e:16"/>
Aug 02 23:57:23 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:57:23 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:57:23 user nova-compute[72520]:       <target dev="tap571c58f6-40"/>
Aug 02 23:57:23 user nova-compute[72520]:     </interface>
Aug 02 23:57:23 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:57:23 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/console.log" append="off"/>
Aug 02 23:57:23 user nova-compute[72520]:     </serial>
Aug 02 23:57:23 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:57:23 user nova-compute[72520]:     <video>
Aug 02 23:57:23 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:57:23 user nova-compute[72520]:     </video>
Aug 02 23:57:23 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:57:23 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:57:23 user nova-compute[72520]:     </rng>
Aug 02 23:57:23 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:57:23 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:57:23 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:57:23 user nova-compute[72520]:     </memballoon>
Aug 02 23:57:23 user nova-compute[72520]:   </devices>
Aug 02 23:57:23 user nova-compute[72520]: </domain>
Aug 02 23:57:23 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG os_vif [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap571c58f6-40, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap571c58f6-40, col_values=(('external_ids', {'iface-id': '571c58f6-401f-4632-916d-646803b6f25f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:9e:16', 'vm-uuid': '0ada24d4-91f7-4d2f-bd25-6c226d313331'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:23 user nova-compute[72520]: INFO os_vif [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40')
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No VIF found with MAC fa:16:3e:8a:9e:16, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updated VIF entry in instance network info cache for port 571c58f6-401f-4632-916d-646803b6f25f. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG nova.network.neutron [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:57:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-44f558c3-25b6-4925-9ac5-feea4a07adcd req-7bfb705a-c1eb-4f43-9b74-bca74bb5f517 service nova] Releasing lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:57:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-0bd98c84-d4de-4e7b-89f0-942ee3776e84 req-3296c8f6-9a40-4229-b70c-1b51a44197e0 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0bd98c84-d4de-4e7b-89f0-942ee3776e84 req-3296c8f6-9a40-4229-b70c-1b51a44197e0 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0bd98c84-d4de-4e7b-89f0-942ee3776e84 req-3296c8f6-9a40-4229-b70c-1b51a44197e0 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0bd98c84-d4de-4e7b-89f0-942ee3776e84 req-3296c8f6-9a40-4229-b70c-1b51a44197e0 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-0bd98c84-d4de-4e7b-89f0-942ee3776e84 req-3296c8f6-9a40-4229-b70c-1b51a44197e0 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:57:25 user nova-compute[72520]: WARNING nova.compute.manager [req-0bd98c84-d4de-4e7b-89f0-942ee3776e84 req-3296c8f6-9a40-4229-b70c-1b51a44197e0 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state building and task_state spawning.
Aug 02 23:57:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020647.018514, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:57:27 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Resumed (Lifecycle Event)
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:57:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance spawned successfully.
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:57:27 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020647.021932, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:57:27 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Started (Lifecycle Event)
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:57:27 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:57:27 user nova-compute[72520]: INFO nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Took 5.29 seconds to spawn the instance on the hypervisor.
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-6bb73844-025a-45b9-a36b-c883ee763bfa req-86e1d045-45c2-42cb-ba94-0a288f89be36 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6bb73844-025a-45b9-a36b-c883ee763bfa req-86e1d045-45c2-42cb-ba94-0a288f89be36 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6bb73844-025a-45b9-a36b-c883ee763bfa req-86e1d045-45c2-42cb-ba94-0a288f89be36 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6bb73844-025a-45b9-a36b-c883ee763bfa req-86e1d045-45c2-42cb-ba94-0a288f89be36 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:27 user nova-compute[72520]: DEBUG nova.compute.manager [req-6bb73844-025a-45b9-a36b-c883ee763bfa req-86e1d045-45c2-42cb-ba94-0a288f89be36 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:57:27 user nova-compute[72520]: WARNING nova.compute.manager [req-6bb73844-025a-45b9-a36b-c883ee763bfa req-86e1d045-45c2-42cb-ba94-0a288f89be36 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state building and task_state spawning.
Aug 02 23:57:27 user nova-compute[72520]: INFO nova.compute.manager [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Took 5.88 seconds to build instance.
Aug 02 23:57:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f7caaa7e-3e92-4263-8da8-bc027716217d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.969s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "525c1354-331d-4075-95af-df3dae596dba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "525c1354-331d-4075-95af-df3dae596dba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:57:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:57:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:57:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:57:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:57:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:57:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-changed-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:57:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Refreshing instance network info cache due to event network-changed-fd871833-3bb6-4119-b904-e27a4440e86b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:57:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:57:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:57:49 user nova-compute[72520]: DEBUG nova.network.neutron [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Refreshing network info cache for port fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:57:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updated VIF entry in instance network info cache for port fd871833-3bb6-4119-b904-e27a4440e86b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:57:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:57:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fac2f5e1-7bb4-4e1c-a8e7-ca4801f3d784 req-fcae82f6-3947-4c80-86dc-2d125a42bf77 service nova] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:57:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:57:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing instance network info cache due to event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:57:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:57:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:57:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updated VIF entry in instance network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8f68a7cd-0279-4754-a01d-13dc8813cc60 req-c44cca01-4c42-4bb1-ac89-1c28f0cd1455 service nova] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing instance network info cache due to event network-changed-b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Refreshing network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:57:58 user nova-compute[72520]: INFO nova.compute.manager [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Detaching volume 3246ec6e-bb6c-46c6-9a71-9673a5ff60a5
Aug 02 23:57:58 user nova-compute[72520]: INFO nova.virt.block_device [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Attempting to driver detach volume 3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 from mountpoint /dev/vdb
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Attempting to detach device vdb from instance d8b74c7b-117b-4f86-a593-d767e6def722 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:57:58 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:57:58 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:57:58 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:57:58 user nova-compute[72520]:   <serial>3246ec6e-bb6c-46c6-9a71-9673a5ff60a5</serial>
Aug 02 23:57:58 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:57:58 user nova-compute[72520]: </disk>
Aug 02 23:57:58 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:57:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully detached device vdb from instance d8b74c7b-117b-4f86-a593-d767e6def722 from the persistent domain config.
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8b74c7b-117b-4f86-a593-d767e6def722 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:57:58 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:57:58 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 02 23:57:58 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:57:58 user nova-compute[72520]:   <serial>3246ec6e-bb6c-46c6-9a71-9673a5ff60a5</serial>
Aug 02 23:57:58 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:57:58 user nova-compute[72520]: </disk>
Aug 02 23:57:58 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updated VIF entry in instance network info cache for port b996723b-e8bb-4337-adb3-cad586295e6b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:57:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea1ef23a-cf48-428e-89a4-bec60695a78f req-0d07480f-027c-4c88-a36c-b5eda97feb4d service nova] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020679.219828, d8b74c7b-117b-4f86-a593-d767e6def722 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:57:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully detached device vdb from instance d8b74c7b-117b-4f86-a593-d767e6def722 from the live domain config.
Aug 02 23:57:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlAzIPnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:57:59 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b901150-e164-48cb-adce-a38d0255a947]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72db58d-de93-45f6-90d1-3cd5d6f53b0b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 (non-flash)
Aug 02 23:57:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 (non-flash)
Aug 02 23:57:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d0a4e2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[889dd394-f1d5-49a0-8270-0620239e5833]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b800047-94e3-4587-9148-62257b56ccff]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796532f-aac7-444f-bfb5-ce25c18c1878]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43597ff7-891e-4902-83e1-edcde9e63027]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0913c63-610b-4bc0-9c3b-c83c7365642e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851f51e-46ac-4020-8af8-2071b2842900]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260]
Aug 02 23:57:59 user nova-compute[72520]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5, portal: 172.16.0.220,3260] successful.
Aug 02 23:57:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3246ec6e-bb6c-46c6-9a71-9673a5ff60a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0740016-264a-448c-98c0-a44549fdaa53]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] <== disconnect_volume: return (274ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:57:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'flavor' on Instance uuid d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-84f1f3bb-bb8c-43ee-a18b-277590c1004d tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [{"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-d8b74c7b-117b-4f86-a593-d767e6def722" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:58:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:58:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:01 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:02 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:07 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:58:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8171MB free_disk=25.153640747070312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d8b74c7b-117b-4f86-a593-d767e6def722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:58:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:58:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:58:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:58:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:27 user nova-compute[72520]: INFO nova.compute.manager [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Unshelving
Aug 02 23:58:27 user nova-compute[72520]: INFO nova.virt.block_device [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Booting with volume 9e240b5b-d710-4ed8-b790-f4064cc7244d at /dev/vdc
Aug 02 23:58:27 user nova-compute[72520]: DEBUG os_brick.utils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d941ac-60bf-43b5-95eb-23ef5184ee81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d78bb7c-9fea-4ffe-b79d-fe204b172cf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2ad67-e5d0-4e99-8eee-e29ebd636377]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd264645-30bc-49e7-acef-5e5506f6b5fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:58:27 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:58:27 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bdb2e1-3e61-4b5a-b9b0-a7e8d875a122]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG os_brick.utils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:58:27 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating existing volume attachment record: 3f60fdbe-6e47-4d28-a17d-5dadc3c765be {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:58:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:58:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:58:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:58:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:34 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:58:34 user nova-compute[72520]: INFO nova.compute.claims [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Claim successful on node user
Aug 02 23:58:35 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:35 user nova-compute[72520]: INFO nova.network.neutron [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating port cb2a1afa-6a4f-4e19-bd5f-6255baa05956 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG nova.network.neutron [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing instance network info cache due to event network-changed-cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:58:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 02 23:58:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Creating image(s)
Aug 02 23:58:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG nova.objects.instance [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG nova.network.neutron [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Refreshing network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG nova.virt.images [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] a2fbc699-b01a-4f08-b926-9e590cdfdffa was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.part /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.part /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.converted" returned: 0 in 0.223s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG nova.network.neutron [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updated VIF entry in instance network info cache for port cb2a1afa-6a4f-4e19-bd5f-6255baa05956. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG nova.network.neutron [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-af903a45-8581-4b42-a9ee-c5644d4dcb96 req-b384c945-da23-4a79-964c-d0f8a8e4cab2 service nova] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.502s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3 --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3 --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3,backing_fmt=raw /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3,backing_fmt=raw /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk 1073741824" returned: 0 in 0.066s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3 --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3 --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG nova.objects.instance [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'migration_context' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Rebasing disk image.
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab -F raw /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab -F raw /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk" returned: 0 in 1.964s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Ensure instance console log exists: /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Start _get_guest_xml network_info=[{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='29c5d23683df06a4c3f26364e41c1923',container_format='bare',created_at=2023-08-02T23:56:35Z,direct_url=<?>,disk_format='qcow2',id=a2fbc699-b01a-4f08-b926-9e590cdfdffa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1538732641-shelved',owner='a16f380acff84d95b2bfb049709f4246',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-02T23:56:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjihfYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4b47e71c-4d43-4727-97ac-a47ff88b6c2c', 'attached_at': '', 'detached_at': '', 'volume_id': '9e240b5b-d710-4ed8-b790-f4064cc7244d', 'serial': '9e240b5b-d710-4ed8-b790-f4064cc7244d'}, 'attachment_id': '3f60fdbe-6e47-4d28-a17d-5dadc3c765be', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 02 23:58:40 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:58:40 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='29c5d23683df06a4c3f26364e41c1923',container_format='bare',created_at=2023-08-02T23:56:35Z,direct_url=<?>,disk_format='qcow2',id=a2fbc699-b01a-4f08-b926-9e590cdfdffa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1538732641-shelved',owner='a16f380acff84d95b2bfb049709f4246',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-02T23:56:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.objects.instance [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjihfYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:58:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:58:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:58:40 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6826efc-8b96-4e03-8b64-45a5ec94b6cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:58:40 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd3bfe1-f650-4895-a218-951f39159a49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d] added
Aug 02 23:58:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e24372e-7c1f-4360-9399-09842bf01d6f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf7c91d-5a9e-4c0f-8522-5bcc304b1213]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjihfYwQ {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjihfYwQ" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[84919e17-af3f-4a57-b619-dcf0a618a686]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IjihfYwQ'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6da0e7-5ccd-4f72-a073-badfc05e76b3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17aede-1c05-4eeb-b4c9-cf39ff46b3e1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:58:40 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 02 23:58:40 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:58:40 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 02 23:58:40 user nova-compute[72520]: 
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbd9098-50a1-4b5b-ab2e-9cca5034c2a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260]
Aug 02 23:58:40 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260] successful.
Aug 02 23:58:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdc59b2-053e-462d-a098-e2c5bd8e01fb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3f7b8-d94e-4db6-b44e-7ea73b027ddc]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:58:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:58:40 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4376e8-10e1-4412-a0fb-0b3afb315968]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:58:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjihfYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23934333439363231', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934333439363231', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1538732641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1538732641',id=34,image_ref='a2fbc699-b01a-4f08-b926-9e590cdfdffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-641100772',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:54:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-4ofkuknn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member',shelved_at='2023-08-02T23:56:38.259985',shelved_host='user',shelved_image_id='a2fbc699-b01a-4f08-b926-9e590cdfdffa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=4b47e71c-4d43-4727-97ac-a47ff88b6c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.objects.instance [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] End _get_guest_xml xml=<domain type="kvm">
Aug 02 23:58:41 user nova-compute[72520]:   <uuid>4b47e71c-4d43-4727-97ac-a47ff88b6c2c</uuid>
Aug 02 23:58:41 user nova-compute[72520]:   <name>instance-00000022</name>
Aug 02 23:58:41 user nova-compute[72520]:   <memory>524288</memory>
Aug 02 23:58:41 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 02 23:58:41 user nova-compute[72520]:   <metadata>
Aug 02 23:58:41 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 02 23:58:41 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 02 23:58:41 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1538732641</nova:name>
Aug 02 23:58:41 user nova-compute[72520]:       <nova:creationTime>2023-08-02 23:58:40</nova:creationTime>
Aug 02 23:58:41 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 02 23:58:41 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 02 23:58:41 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 02 23:58:41 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 02 23:58:41 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 02 23:58:41 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 02 23:58:41 user nova-compute[72520]:       </nova:flavor>
Aug 02 23:58:41 user nova-compute[72520]:       <nova:owner>
Aug 02 23:58:41 user nova-compute[72520]:         <nova:user uuid="4f9ec64c4b24430e8f7ee755a9f37806">tempest-AttachVolumeShelveTestJSON-952018091-project-member</nova:user>
Aug 02 23:58:41 user nova-compute[72520]:         <nova:project uuid="a16f380acff84d95b2bfb049709f4246">tempest-AttachVolumeShelveTestJSON-952018091</nova:project>
Aug 02 23:58:41 user nova-compute[72520]:       </nova:owner>
Aug 02 23:58:41 user nova-compute[72520]:       <nova:root type="image" uuid="a2fbc699-b01a-4f08-b926-9e590cdfdffa"/>
Aug 02 23:58:41 user nova-compute[72520]:       <nova:ports>
Aug 02 23:58:41 user nova-compute[72520]:         <nova:port uuid="cb2a1afa-6a4f-4e19-bd5f-6255baa05956">
Aug 02 23:58:41 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 02 23:58:41 user nova-compute[72520]:         </nova:port>
Aug 02 23:58:41 user nova-compute[72520]:       </nova:ports>
Aug 02 23:58:41 user nova-compute[72520]:     </nova:instance>
Aug 02 23:58:41 user nova-compute[72520]:   </metadata>
Aug 02 23:58:41 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 02 23:58:41 user nova-compute[72520]:     <system>
Aug 02 23:58:41 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 02 23:58:41 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 02 23:58:41 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 02 23:58:41 user nova-compute[72520]:       <entry name="serial">4b47e71c-4d43-4727-97ac-a47ff88b6c2c</entry>
Aug 02 23:58:41 user nova-compute[72520]:       <entry name="uuid">4b47e71c-4d43-4727-97ac-a47ff88b6c2c</entry>
Aug 02 23:58:41 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 02 23:58:41 user nova-compute[72520]:     </system>
Aug 02 23:58:41 user nova-compute[72520]:   </sysinfo>
Aug 02 23:58:41 user nova-compute[72520]:   <os>
Aug 02 23:58:41 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 02 23:58:41 user nova-compute[72520]:     <boot dev="hd"/>
Aug 02 23:58:41 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 02 23:58:41 user nova-compute[72520]:   </os>
Aug 02 23:58:41 user nova-compute[72520]:   <features>
Aug 02 23:58:41 user nova-compute[72520]:     <acpi/>
Aug 02 23:58:41 user nova-compute[72520]:     <apic/>
Aug 02 23:58:41 user nova-compute[72520]:     <vmcoreinfo/>
Aug 02 23:58:41 user nova-compute[72520]:   </features>
Aug 02 23:58:41 user nova-compute[72520]:   <clock offset="utc">
Aug 02 23:58:41 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 02 23:58:41 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 02 23:58:41 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 02 23:58:41 user nova-compute[72520]:   </clock>
Aug 02 23:58:41 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 02 23:58:41 user nova-compute[72520]:     <model>Nehalem</model>
Aug 02 23:58:41 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 02 23:58:41 user nova-compute[72520]:   </cpu>
Aug 02 23:58:41 user nova-compute[72520]:   <devices>
Aug 02 23:58:41 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 02 23:58:41 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 02 23:58:41 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk"/>
Aug 02 23:58:41 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 02 23:58:41 user nova-compute[72520]:     </disk>
Aug 02 23:58:41 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 02 23:58:41 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:58:41 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 02 23:58:41 user nova-compute[72520]:       <target dev="vdc" bus="virtio"/>
Aug 02 23:58:41 user nova-compute[72520]:       <serial>9e240b5b-d710-4ed8-b790-f4064cc7244d</serial>
Aug 02 23:58:41 user nova-compute[72520]:     </disk>
Aug 02 23:58:41 user nova-compute[72520]:     <interface type="ethernet">
Aug 02 23:58:41 user nova-compute[72520]:       <mac address="fa:16:3e:e3:9d:06"/>
Aug 02 23:58:41 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:58:41 user nova-compute[72520]:       <mtu size="1442"/>
Aug 02 23:58:41 user nova-compute[72520]:       <target dev="tapcb2a1afa-6a"/>
Aug 02 23:58:41 user nova-compute[72520]:     </interface>
Aug 02 23:58:41 user nova-compute[72520]:     <serial type="pty">
Aug 02 23:58:41 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/console.log" append="off"/>
Aug 02 23:58:41 user nova-compute[72520]:     </serial>
Aug 02 23:58:41 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 02 23:58:41 user nova-compute[72520]:     <video>
Aug 02 23:58:41 user nova-compute[72520]:       <model type="virtio"/>
Aug 02 23:58:41 user nova-compute[72520]:     </video>
Aug 02 23:58:41 user nova-compute[72520]:     <rng model="virtio">
Aug 02 23:58:41 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 02 23:58:41 user nova-compute[72520]:     </rng>
Aug 02 23:58:41 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 02 23:58:41 user nova-compute[72520]:     <memballoon model="virtio">
Aug 02 23:58:41 user nova-compute[72520]:       <stats period="10"/>
Aug 02 23:58:41 user nova-compute[72520]:     </memballoon>
Aug 02 23:58:41 user nova-compute[72520]:   </devices>
Aug 02 23:58:41 user nova-compute[72520]: </domain>
Aug 02 23:58:41 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1538732641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1538732641',id=34,image_ref='a2fbc699-b01a-4f08-b926-9e590cdfdffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-641100772',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:54:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-4ofkuknn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member',shelved_at='2023-08-02T23:56:38.259985',shelved_host='user',shelved_image_id='a2fbc699-b01a-4f08-b926-9e590cdfdffa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=4b47e71c-4d43-4727-97ac-a47ff88b6c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG os_vif [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb2a1afa-6a, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb2a1afa-6a, col_values=(('external_ids', {'iface-id': 'cb2a1afa-6a4f-4e19-bd5f-6255baa05956', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:9d:06', 'vm-uuid': '4b47e71c-4d43-4727-97ac-a47ff88b6c2c'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:41 user nova-compute[72520]: INFO os_vif [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a')
Aug 02 23:58:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:58:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:58:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No VIF found with MAC fa:16:3e:e3:9d:06, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-e4d047f8-c1b4-4ada-ac8c-f0ee7b44094b req-a63a7397-b3f7-476c-a5fd-4a34c5caf7ef service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e4d047f8-c1b4-4ada-ac8c-f0ee7b44094b req-a63a7397-b3f7-476c-a5fd-4a34c5caf7ef service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e4d047f8-c1b4-4ada-ac8c-f0ee7b44094b req-a63a7397-b3f7-476c-a5fd-4a34c5caf7ef service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e4d047f8-c1b4-4ada-ac8c-f0ee7b44094b req-a63a7397-b3f7-476c-a5fd-4a34c5caf7ef service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-e4d047f8-c1b4-4ada-ac8c-f0ee7b44094b req-a63a7397-b3f7-476c-a5fd-4a34c5caf7ef service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:58:43 user nova-compute[72520]: WARNING nova.compute.manager [req-e4d047f8-c1b4-4ada-ac8c-f0ee7b44094b req-a63a7397-b3f7-476c-a5fd-4a34c5caf7ef service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received unexpected event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 02 23:58:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-changed-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Refreshing instance network info cache due to event network-changed-7adff173-4541-4202-901d-d07f843f301b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] Acquiring lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] Acquired lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG nova.network.neutron [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Refreshing network info cache for port 7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG nova.network.neutron [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updated VIF entry in instance network info cache for port 7adff173-4541-4202-901d-d07f843f301b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG nova.network.neutron [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updating instance_info_cache with network_info: [{"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1dc94fc7-493b-4d66-9aac-409946ee4cee req-bc0fadfc-a04a-44fc-b9ae-fa5370aefd16 service nova] Releasing lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG nova.objects.instance [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'flavor' on Instance uuid 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:44 user nova-compute[72520]: INFO nova.compute.manager [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Attaching volume 595674ad-2359-4cdc-9a2f-756e51b4416f to /dev/vdb
Aug 02 23:58:44 user nova-compute[72520]: DEBUG os_brick.utils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef022d58-2a10-44a1-8c19-451bca295b01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c07e6-b33b-497e-b46e-a2b875807217]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ada7a87-f711-4b70-ba20-b13f3a23ee49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcecb767-e900-4737-a97f-8beaa4e4a2af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:58:44 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:58:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e000dc4e-0962-4e93-b5d9-7727520c3355]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG os_brick.utils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:58:44 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updating existing volume attachment record: 99dc31af-e795-4f57-99b6-e7c7c97443fd {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020725.4243574, 4b47e71c-4d43-4727-97ac-a47ff88b6c2c => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:58:45 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] VM Resumed (Lifecycle Event)
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 02 23:58:45 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance spawned successfully.
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:58:45 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020725.4260683, 4b47e71c-4d43-4727-97ac-a47ff88b6c2c => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:58:45 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] VM Started (Lifecycle Event)
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:58:45 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-87ff7970-bf01-48f9-aa56-364071cee48f req-deb3b277-0286-42e4-90e9-b6da2534b7ed service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-87ff7970-bf01-48f9-aa56-364071cee48f req-deb3b277-0286-42e4-90e9-b6da2534b7ed service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-87ff7970-bf01-48f9-aa56-364071cee48f req-deb3b277-0286-42e4-90e9-b6da2534b7ed service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-87ff7970-bf01-48f9-aa56-364071cee48f req-deb3b277-0286-42e4-90e9-b6da2534b7ed service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [req-87ff7970-bf01-48f9-aa56-364071cee48f req-deb3b277-0286-42e4-90e9-b6da2534b7ed service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:58:45 user nova-compute[72520]: WARNING nova.compute.manager [req-87ff7970-bf01-48f9-aa56-364071cee48f req-deb3b277-0286-42e4-90e9-b6da2534b7ed service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received unexpected event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 02 23:58:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:58:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-612a9a82-1b28-4d6b-a8ff-6e86e6585484 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.680s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkeocBnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:58:56 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:58:56 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:58:56 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa094f-2b04-462d-9a0a-93aaf19b5531]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:58:56 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccb58d1-f263-48d6-8eb1-efe2e59d88c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f] added
Aug 02 23:58:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea88d9b3-26c4-45a2-abf4-da5a00a2fe57]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba6db4-b200-4832-b35a-718d4ee6c48a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkeocBnY {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkeocBnY" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c0d68-a981-4aac-b528-bc72e305990c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkeocBnY'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a458e869-f5cb-4c23-9d56-99aea47edae7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a1ec9-8180-445a-b73d-f47a39f5cfe2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:58:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:58:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb21e23-a5cf-4e36-9720-7eadfe4cf220]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260]
Aug 02 23:58:56 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260] successful.
Aug 02 23:58:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f950878-6216-4ab3-bb1e-44065d748b09]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a112c3a2-11d6-4a35-939d-59c8c85f681e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:58:56 user nova-compute[72520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f (non-flash)
Aug 02 23:58:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:58:56 user nova-compute[72520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f (non-flash)
Aug 02 23:58:56 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac17fff-06aa-492e-bdbb-713de8413a47]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkeocBnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:56 user nova-compute[72520]: INFO nova.compute.manager [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Terminating instance
Aug 02 23:58:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-6859e7c8-3713-4dbe-bd9d-cc9b57f04be9 req-ca0b3cc3-c991-487c-ae1c-50ff9f1c2240 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-unplugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6859e7c8-3713-4dbe-bd9d-cc9b57f04be9 req-ca0b3cc3-c991-487c-ae1c-50ff9f1c2240 service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6859e7c8-3713-4dbe-bd9d-cc9b57f04be9 req-ca0b3cc3-c991-487c-ae1c-50ff9f1c2240 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6859e7c8-3713-4dbe-bd9d-cc9b57f04be9 req-ca0b3cc3-c991-487c-ae1c-50ff9f1c2240 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-6859e7c8-3713-4dbe-bd9d-cc9b57f04be9 req-ca0b3cc3-c991-487c-ae1c-50ff9f1c2240 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-unplugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-6859e7c8-3713-4dbe-bd9d-cc9b57f04be9 req-ca0b3cc3-c991-487c-ae1c-50ff9f1c2240 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-unplugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:58:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Instance destroyed successfully.
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lazy-loading 'resources' on Instance uuid d8b74c7b-117b-4f86-a593-d767e6def722 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335891746',display_name='tempest-TestMinimumBasicScenario-server-1335891746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335891746',id=33,image_ref='1c257d33-0c46-4827-8053-23827139000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg3pz/7Pc297fwE6KJqjswQuc0vk5z0LqvlpfGy2wpsF21uZhtDV9INV971y9p29dTVhSeerl8OPaobfvLGkqJn6N2TAUfTHDGtBVFrPo7sRllOC/5GxS9ju4JkLqLJbw==',key_name='tempest-TestMinimumBasicScenario-250276219',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b274c7dd5374d739bd700643b0bf63e',ramdisk_id='',reservation_id='r-8z07iel0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c257d33-0c46-4827-8053-23827139000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-951726597',owner_user_name='tempest-TestMinimumBasicScenario-951726597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:56:13Z,user_data=None,user_id='c7b27a450e444b308fc54577d724cc7a',uuid=d8b74c7b-117b-4f86-a593-d767e6def722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converting VIF {"id": "b996723b-e8bb-4337-adb3-cad586295e6b", "address": "fa:16:3e:a6:ab:a8", "network": {"id": "fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1140736773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b274c7dd5374d739bd700643b0bf63e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb996723b-e8", "ovs_interfaceid": "b996723b-e8bb-4337-adb3-cad586295e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=b996723b-e8bb-4337-adb3-cad586295e6b,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb996723b-e8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG os_vif [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=b996723b-e8bb-4337-adb3-cad586295e6b,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb996723b-e8') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb996723b-e8, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23234333138613136', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234333138613136', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:58:57 user nova-compute[72520]: INFO os_vif [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:ab:a8,bridge_name='br-int',has_traffic_filtering=True,id=b996723b-e8bb-4337-adb3-cad586295e6b,network=Network(fdb4d4c9-08bb-4f2b-9ce8-58c9f1f478b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb996723b-e8')
Aug 02 23:58:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Deleting instance files /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722_del
Aug 02 23:58:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Deletion of /opt/stack/data/nova/instances/d8b74c7b-117b-4f86-a593-d767e6def722_del complete
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'flavor' on Instance uuid 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:58:57 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:58:57 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:58:57 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:58:57 user nova-compute[72520]:   <serial>595674ad-2359-4cdc-9a2f-756e51b4416f</serial>
Aug 02 23:58:57 user nova-compute[72520]: </disk>
Aug 02 23:58:57 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:58:57 user nova-compute[72520]: INFO nova.compute.manager [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 02 23:58:57 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:58:57 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] No VIF found with MAC fa:16:3e:04:f5:e3, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98010ca5-24ac-41ee-a2bc-f0f30ef0bd07 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.586s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:58:58 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Took 0.68 seconds to deallocate network for instance.
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d69b20b-7ffb-4396-8cf9-36cce0842fa5 req-3ee0547a-b87a-4084-a929-3cb91605e8da service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-deleted-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:58:58 user nova-compute[72520]: INFO nova.compute.manager [req-8d69b20b-7ffb-4396-8cf9-36cce0842fa5 req-3ee0547a-b87a-4084-a929-3cb91605e8da service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Neutron deleted interface b996723b-e8bb-4337-adb3-cad586295e6b; detaching it from the instance and deleting it from the info cache
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.network.neutron [req-8d69b20b-7ffb-4396-8cf9-36cce0842fa5 req-3ee0547a-b87a-4084-a929-3cb91605e8da service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-8d69b20b-7ffb-4396-8cf9-36cce0842fa5 req-3ee0547a-b87a-4084-a929-3cb91605e8da service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Detach interface failed, port_id=b996723b-e8bb-4337-adb3-cad586295e6b, reason: Instance d8b74c7b-117b-4f86-a593-d767e6def722 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:58:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:58 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Deleted allocations for instance d8b74c7b-117b-4f86-a593-d767e6def722
Aug 02 23:58:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-04ec96a4-b11e-4b02-bd0c-827805fb0bda tempest-TestMinimumBasicScenario-951726597 tempest-TestMinimumBasicScenario-951726597-project-member] Lock "d8b74c7b-117b-4f86-a593-d767e6def722" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.046s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-20968f28-ab10-4b6f-be3e-103ace754d7a req-bb1fb529-a716-4de5-81ae-16e2aa0833a9 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-20968f28-ab10-4b6f-be3e-103ace754d7a req-bb1fb529-a716-4de5-81ae-16e2aa0833a9 service nova] Acquiring lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-20968f28-ab10-4b6f-be3e-103ace754d7a req-bb1fb529-a716-4de5-81ae-16e2aa0833a9 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-20968f28-ab10-4b6f-be3e-103ace754d7a req-bb1fb529-a716-4de5-81ae-16e2aa0833a9 service nova] Lock "d8b74c7b-117b-4f86-a593-d767e6def722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-20968f28-ab10-4b6f-be3e-103ace754d7a req-bb1fb529-a716-4de5-81ae-16e2aa0833a9 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] No waiting events found dispatching network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:58:59 user nova-compute[72520]: WARNING nova.compute.manager [req-20968f28-ab10-4b6f-be3e-103ace754d7a req-bb1fb529-a716-4de5-81ae-16e2aa0833a9 service nova] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Received unexpected event network-vif-plugged-b996723b-e8bb-4337-adb3-cad586295e6b for instance with vm_state deleted and task_state None.
Aug 02 23:58:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:58:59 user nova-compute[72520]: INFO nova.compute.manager [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Detaching volume 595674ad-2359-4cdc-9a2f-756e51b4416f
Aug 02 23:58:59 user nova-compute[72520]: INFO nova.virt.block_device [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Attempting to driver detach volume 595674ad-2359-4cdc-9a2f-756e51b4416f from mountpoint /dev/vdb
Aug 02 23:58:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Attempting to detach device vdb from instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:58:59 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:58:59 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:58:59 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:58:59 user nova-compute[72520]:   <serial>595674ad-2359-4cdc-9a2f-756e51b4416f</serial>
Aug 02 23:58:59 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:58:59 user nova-compute[72520]: </disk>
Aug 02 23:58:59 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:58:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully detached device vdb from instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 from the persistent domain config.
Aug 02 23:58:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 02 23:58:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] detach device xml: <disk type="block" device="disk">
Aug 02 23:58:59 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:58:59 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:58:59 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:58:59 user nova-compute[72520]:   <serial>595674ad-2359-4cdc-9a2f-756e51b4416f</serial>
Aug 02 23:58:59 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 02 23:58:59 user nova-compute[72520]: </disk>
Aug 02 23:58:59 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020740.336599, 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 02 23:59:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully detached device vdb from instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 from the live domain config.
Aug 02 23:59:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkeocBnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:59:00 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f45cf77-a080-4fe5-9b7d-f8f1dbf1414b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2f839b-a5f9-4860-8f83-76a2349e680f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:00 user nova-compute[72520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f (non-flash)
Aug 02 23:59:00 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:00 user nova-compute[72520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f (non-flash)
Aug 02 23:59:00 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce426f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc38044-1f58-4b17-a8b7-e85c1cb22a80]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc64f5cb-d638-45fa-b18d-6acd2e14e204]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b16afbd-f82b-474f-a093-a39ff63adef4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a264e2ef-182d-4ff6-8875-d60de6e4e7b0]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe5788-4c3a-4ae5-afb0-46dfe0dad2c9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf35969-1fee-4777-83ca-d596c17e548e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260]
Aug 02 23:59:00 user nova-compute[72520]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f, portal: 172.16.0.220,3260] successful.
Aug 02 23:59:00 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595674ad-2359-4cdc-9a2f-756e51b4416f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b5bce-102b-416f-891d-3277a7cb4382]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] <== disconnect_volume: return (277ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:59:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:59:01 user nova-compute[72520]: DEBUG nova.objects.instance [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'flavor' on Instance uuid 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-69728c8c-2f2a-4fb5-b398-93343ceb8c57 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.571s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:06 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:59:08 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:59:10 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8091MB free_disk=25.15450668334961GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 02 23:59:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-changed-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Refreshing instance network info cache due to event network-changed-571c58f6-401f-4632-916d-646803b6f25f. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] Acquiring lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] Acquired lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Refreshing network info cache for port 571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updated VIF entry in instance network info cache for port 571c58f6-401f-4632-916d-646803b6f25f. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4441d00a-8b5e-4724-bcc1-6024d264a9c6 req-bee42ea5-1d39-461a-9c2c-8966e53d8b2d service nova] Releasing lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020737.6795373, d8b74c7b-117b-4f86-a593-d767e6def722 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:59:12 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] VM Stopped (Lifecycle Event)
Aug 02 23:59:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6bab5495-d5f0-45c8-b06c-5e851802f846 None None] [instance: d8b74c7b-117b-4f86-a593-d767e6def722] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 02 23:59:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:16 user nova-compute[72520]: INFO nova.compute.manager [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Attaching volume ddaa4491-23a1-4b9c-b1ee-e485594a73f3 to /dev/vdb
Aug 02 23:59:16 user nova-compute[72520]: DEBUG os_brick.utils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe85c9a-b376-464b-9085-8450844932e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[176188b2-ee73-4d81-a761-41ce6fd74a13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[983319e6-cc71-4a01-bd34-7b4c70f1a06e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1164327a-8d0e-4fbb-a6ca-fe373cf7227e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:59:16 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:59:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb0e943-a38f-49e0-81a3-f9f5c953626e]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG os_brick.utils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:59:16 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating existing volume attachment record: 5f016ebc-9d07-4541-8972-17510b6c1d59 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:59:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoANTYrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:59:23 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:59:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:59:23 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:59:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:59:23 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:59:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c822a24-17e2-4240-a7d6-298ac834dbed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:59:23 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[489eeaac-f34c-41ae-a695-9f615927ca51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3] added
Aug 02 23:59:23 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ea50e4-abb1-4481-bd81-4138d3e9bfad]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2524c3-e664-43cc-bfce-7a548411b360]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoANTYrB {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoANTYrB" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47e325-06f3-4a2a-a974-5fdb061a3201]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoANTYrB'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417e7a0-b948-4342-b86d-473a8fd37398]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[697de63b-a3ef-4d8d-9ddd-5890524b79f7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[934bed5c-82bf-4e10-8460-22a9819e1c53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]
Aug 02 23:59:24 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.
Aug 02 23:59:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f12557c-ee34-4b74-b9ec-e06b245264d6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd3e741-a397-4c7c-9487-98e78f46f064]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:24 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:24 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:24 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[74899ca6-4a3b-4da8-8aee-3d42a7042b7d]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:59:24 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoANTYrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26636663739343862', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663739343862', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:59:25 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:59:25 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 02 23:59:25 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:59:25 user nova-compute[72520]:   <serial>ddaa4491-23a1-4b9c-b1ee-e485594a73f3</serial>
Aug 02 23:59:25 user nova-compute[72520]: </disk>
Aug 02 23:59:25 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No VIF found with MAC fa:16:3e:8a:9e:16, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:59:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8c9e9549-3ffa-4fad-a940-6ffd10ea6c4a tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.196s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ab11db9b-6d9f-4411-9c1b-e10c9ca27217 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ab11db9b-6d9f-4411-9c1b-e10c9ca27217 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ab11db9b-6d9f-4411-9c1b-e10c9ca27217 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ab11db9b-6d9f-4411-9c1b-e10c9ca27217 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72520) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ab11db9b-6d9f-4411-9c1b-e10c9ca27217 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2601ec9-d656-4a75-a2f8-82c10bcbf030 req-d4e3280e-a8c6-4b30-90d0-8fd685453988 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2601ec9-d656-4a75-a2f8-82c10bcbf030 req-d4e3280e-a8c6-4b30-90d0-8fd685453988 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2601ec9-d656-4a75-a2f8-82c10bcbf030 req-d4e3280e-a8c6-4b30-90d0-8fd685453988 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2601ec9-d656-4a75-a2f8-82c10bcbf030 req-d4e3280e-a8c6-4b30-90d0-8fd685453988 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:26 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2601ec9-d656-4a75-a2f8-82c10bcbf030 req-d4e3280e-a8c6-4b30-90d0-8fd685453988 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:59:26 user nova-compute[72520]: WARNING nova.compute.manager [req-c2601ec9-d656-4a75-a2f8-82c10bcbf030 req-d4e3280e-a8c6-4b30-90d0-8fd685453988 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state active and task_state powering-off.
Aug 02 23:59:27 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance destroyed successfully.
Aug 02 23:59:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ab11db9b-6d9f-4411-9c1b-e10c9ca27217 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:59:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ab11db9b-6d9f-4411-9c1b-e10c9ca27217 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.852s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-c4c33be4-4c28-444a-8039-583cf47142db req-2076d68a-dd87-4708-897a-c984044431bb service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4c33be4-4c28-444a-8039-583cf47142db req-2076d68a-dd87-4708-897a-c984044431bb service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4c33be4-4c28-444a-8039-583cf47142db req-2076d68a-dd87-4708-897a-c984044431bb service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4c33be4-4c28-444a-8039-583cf47142db req-2076d68a-dd87-4708-897a-c984044431bb service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-c4c33be4-4c28-444a-8039-583cf47142db req-2076d68a-dd87-4708-897a-c984044431bb service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:59:28 user nova-compute[72520]: WARNING nova.compute.manager [req-c4c33be4-4c28-444a-8039-583cf47142db req-2076d68a-dd87-4708-897a-c984044431bb service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state stopped and task_state None.
Aug 02 23:59:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020767.390778, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 02 23:59:42 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Stopped (Lifecycle Event)
Aug 02 23:59:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f1113e19-f4a8-4abd-9244-34933b55a9d5 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f1113e19-f4a8-4abd-9244-34933b55a9d5 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 02 23:59:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:44 user nova-compute[72520]: DEBUG nova.objects.instance [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'flavor' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:45 user nova-compute[72520]: INFO nova.compute.manager [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Attaching volume e0f07ff6-87a1-4e4c-959b-dc2166b860f3 to /dev/vdb
Aug 02 23:59:45 user nova-compute[72520]: DEBUG os_brick.utils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a7ffc8-be4e-4605-83ff-bf751cb8ef5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[55426836-21e8-4c83-af04-5e078f3f4adf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d0c906-a2f9-4d3d-9340-5d77af29e3c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085da8e-d259-4377-9b73-5d586c0b674f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 02 23:59:45 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 02 23:59:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab72e16-8c01-4a1a-b2f1-5fc1285d1d1c]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG os_brick.utils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:59:45 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating existing volume attachment record: b3515500-3104-472a-8e8b-fcaab068758b {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 02 23:59:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-changed-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Refreshing instance network info cache due to event network-changed-7adff173-4541-4202-901d-d07f843f301b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] Acquiring lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] Acquired lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Refreshing network info cache for port 7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:51 user nova-compute[72520]: INFO nova.compute.manager [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Terminating instance
Aug 02 23:59:51 user nova-compute[72520]: DEBUG nova.compute.manager [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updated VIF entry in instance network info cache for port 7adff173-4541-4202-901d-d07f843f301b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG nova.network.neutron [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updating instance_info_cache with network_info: [{"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:59:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-70636d18-360c-46a4-9cd6-fd0b1c156848 req-3030b19b-bdcb-4914-b8e2-a4601b914240 service nova] Releasing lock "refresh_cache-7373c6f3-5a7b-4b9a-a8cd-0ea478932321" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Instance destroyed successfully.
Aug 02 23:59:52 user nova-compute[72520]: DEBUG nova.objects.instance [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'resources' on Instance uuid 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-593316272',display_name='tempest-TestStampPattern-server-593316272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-593316272',id=36,image_ref='a18fa303-a30b-448a-a9eb-6d6e5372ae75',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfr+fZTq73vPqi3KD8xg6zCQNhY3yvgp2jBtELhyFONrVCY4fZPONJM5IwmbDaDaDReMtv/cCmZk6EIIRiMsEWdetIL8IFplnshiRssnbg415aZgohbu0Rd9qgWXAMv6g==',key_name='tempest-TestStampPattern-2115296246',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0c4d33b6caa44d6945a836e0b19ba10',ramdisk_id='',reservation_id='r-zio5e235',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0fa3db91-fd75-47e6-bce0-f612e5afe5c0',image_min_disk='1',image_min_ram='0',image_owner_id='f0c4d33b6caa44d6945a836e0b19ba10',image_owner_project_name='tempest-TestStampPattern-163390428',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-163390428-project-member',image_user_id='333b602f3a894e4e84db31594de293c7',owner_project_name='tempest-TestStampPattern-163390428',owner_user_name='tempest-TestStampPattern-163390428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:56:58Z,user_data=None,user_id='333b602f3a894e4e84db31594de293c7',uuid=7373c6f3-5a7b-4b9a-a8cd-0ea478932321,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converting VIF {"id": "7adff173-4541-4202-901d-d07f843f301b", "address": "fa:16:3e:04:f5:e3", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adff173-45", "ovs_interfaceid": "7adff173-4541-4202-901d-d07f843f301b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f5:e3,bridge_name='br-int',has_traffic_filtering=True,id=7adff173-4541-4202-901d-d07f843f301b,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adff173-45') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG os_vif [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f5:e3,bridge_name='br-int',has_traffic_filtering=True,id=7adff173-4541-4202-901d-d07f843f301b,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adff173-45') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7adff173-45, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:52 user nova-compute[72520]: INFO os_vif [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f5:e3,bridge_name='br-int',has_traffic_filtering=True,id=7adff173-4541-4202-901d-d07f843f301b,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adff173-45')
Aug 02 23:59:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Deleting instance files /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321_del
Aug 02 23:59:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Deletion of /opt/stack/data/nova/instances/7373c6f3-5a7b-4b9a-a8cd-0ea478932321_del complete
Aug 02 23:59:52 user nova-compute[72520]: INFO nova.compute.manager [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 02 23:59:52 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 02 23:59:52 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:59:53 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:59:53 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:59:53 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bde8d5-acfc-4e8f-b933-47fb673dd876]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 02 23:59:53 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03de3b-7b23-4300-89a5-a6cdff28c277]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3] added
Aug 02 23:59:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-vif-unplugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] No waiting events found dispatching network-vif-unplugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-vif-unplugged-7adff173-4541-4202-901d-d07f843f301b for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] Acquiring lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] No waiting events found dispatching network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:59:53 user nova-compute[72520]: WARNING nova.compute.manager [req-017ec7a8-0c0d-4fa9-9c48-ed97bcd5ad36 req-355c65d9-5a69-499f-bd4c-b1982e93aaa9 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received unexpected event network-vif-plugged-7adff173-4541-4202-901d-d07f843f301b for instance with vm_state active and task_state deleting.
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9389fb4-e7b9-4793-a4a8-f54990519c1b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44f253-3733-4fd3-83b1-b4b7ff55e337]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUlaGWbZ {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUlaGWbZ" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c1eb3-e483-4019-bcff-010c1a9146bf]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XUlaGWbZ'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c724a8-5b87-491f-9b40-15e849a83016]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b7223-1e3a-40d5-959d-31660e29b0d2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:53 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:53 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Took 1.15 seconds to deallocate network for instance.
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-4c457abb-a40c-494d-84f7-d520844b358b req-65712a3a-1196-4f68-93b2-0ab8110510e2 service nova] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Received event network-vif-deleted-7adff173-4541-4202-901d-d07f843f301b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d251d8a4-bd46-421a-90ad-74fa88c2e211]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]
Aug 02 23:59:53 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.
Aug 02 23:59:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b739ab-9605-4ce9-84ee-a8e750a5a4eb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d9a96-29f5-44a9-9f9c-4052c7ad6a31]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:53 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:53 user nova-compute[72520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 02 23:59:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:53 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:53 user nova-compute[72520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 02 23:59:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d56e1c-b1bf-4dd5-9ecd-4626e38105b6]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:53 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Deleted allocations for instance 7373c6f3-5a7b-4b9a-a8cd-0ea478932321
Aug 02 23:59:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4dd7b040-ff35-4475-8d9f-581f9f7b2354 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "7373c6f3-5a7b-4b9a-a8cd-0ea478932321" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26539643837346563', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539643837346563', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'flavor' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] attach device xml: <disk type="block" device="disk">
Aug 02 23:59:54 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 02 23:59:54 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 02 23:59:54 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 02 23:59:54 user nova-compute[72520]:   <serial>e0f07ff6-87a1-4e4c-959b-dc2166b860f3</serial>
Aug 02 23:59:54 user nova-compute[72520]: </disk>
Aug 02 23:59:54 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 02 23:59:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No VIF found with MAC fa:16:3e:06:61:f1, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 02 23:59:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66e8f16b-d417-4e52-bd16-c105bf9caa4e tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.844s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Stashing vm_state: active {{(pid=72520) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'pci_requests' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 02 23:59:57 user nova-compute[72520]: INFO nova.compute.claims [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Claim successful on node user
Aug 02 23:59:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'resources' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'pci_devices' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 02 23:59:57 user nova-compute[72520]: INFO nova.compute.resource_tracker [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating resource usage from migration 607ca200-e25a-4382-93d3-9eb76ded7812
Aug 02 23:59:57 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 02 23:59:57 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.291s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:58 user nova-compute[72520]: INFO nova.compute.manager [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Migrating
Aug 02 23:59:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Starting migrate_disk_and_power_off {{(pid=72520) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-d27d0140-c5a4-4d0d-9029-5154fe617621 req-8ca63dbe-4a0b-450d-9290-a4ed89e3d038 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d27d0140-c5a4-4d0d-9029-5154fe617621 req-8ca63dbe-4a0b-450d-9290-a4ed89e3d038 service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d27d0140-c5a4-4d0d-9029-5154fe617621 req-8ca63dbe-4a0b-450d-9290-a4ed89e3d038 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d27d0140-c5a4-4d0d-9029-5154fe617621 req-8ca63dbe-4a0b-450d-9290-a4ed89e3d038 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 02 23:59:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-d27d0140-c5a4-4d0d-9029-5154fe617621 req-8ca63dbe-4a0b-450d-9290-a4ed89e3d038 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 02 23:59:58 user nova-compute[72520]: WARNING nova.compute.manager [req-d27d0140-c5a4-4d0d-9029-5154fe617621 req-8ca63dbe-4a0b-450d-9290-a4ed89e3d038 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state active and task_state resize_migrating.
Aug 02 23:59:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance destroyed successfully.
Aug 02 23:59:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:59:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1100094194-network", "vif_mac": "fa:16:3e:06:61:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1100094194-network", "vif_mac": "fa:16:3e:06:61:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_vif [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd871833-3b, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 02 23:59:59 user nova-compute[72520]: INFO os_vif [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b')
Aug 02 23:59:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 02 23:59:59 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb58c8-7189-4063-ac0d-cfab5a5b07ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34cd99-b9fd-4ee4-af86-326e1f2206b7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:59 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:59 user nova-compute[72520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 02 23:59:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 02 23:59:59 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 02 23:59:59 user nova-compute[72520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 02 23:59:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4697490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b4ac0d-09c2-4e98-86a8-a5e532b75270]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d168d9e2-4385-4183-ab3b-8c4eedf6e704]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[daac5e79-cacb-4b10-bdeb-9dee4338dbb9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a33aed-0c9d-4b08-81f4-814c26ca2753]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[811377e1-1bdc-4eb6-b753-d5995fae7b99]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8e6e1-aae7-44b9-a237-e03c5cfa3980]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]
Aug 02 23:59:59 user nova-compute[72520]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.
Aug 02 23:59:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7065516-53cb-4a21-b245-00a8f1734d27]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== disconnect_volume: return (276ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 02 23:59:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba_resize/disk /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "cp -r /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba_resize/disk /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk" returned: 0 in 0.327s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba_resize/disk.info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk.info {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "cp -r /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba_resize/disk.info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk.info" returned: 0 in 0.036s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-ff6999b0-e1a4-4a25-a92a-5686f6d8feb2 req-47dd8dbe-ab17-4056-a38f-525c8cf00917 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ff6999b0-e1a4-4a25-a92a-5686f6d8feb2 req-47dd8dbe-ab17-4056-a38f-525c8cf00917 service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ff6999b0-e1a4-4a25-a92a-5686f6d8feb2 req-47dd8dbe-ab17-4056-a38f-525c8cf00917 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ff6999b0-e1a4-4a25-a92a-5686f6d8feb2 req-47dd8dbe-ab17-4056-a38f-525c8cf00917 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-ff6999b0-e1a4-4a25-a92a-5686f6d8feb2 req-47dd8dbe-ab17-4056-a38f-525c8cf00917 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:00:01 user nova-compute[72520]: WARNING nova.compute.manager [req-ff6999b0-e1a4-4a25-a92a-5686f6d8feb2 req-47dd8dbe-ab17-4056-a38f-525c8cf00917 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state active and task_state resize_migrating.
Aug 03 00:00:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Port fd871833-3bb6-4119-b904-e27a4440e86b binding to destination host user is already ACTIVE {{(pid=72520) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:00:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG os_brick.utils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[618f08ba-ee1f-4812-a54a-15e3600427b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ab0f42-c55c-491d-89a2-343ab13e22d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[39913642-cdd8-463c-8931-d9fcb0061aab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2523edf-fffe-4e2c-bd72-67f2140308fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:00:02 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:00:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a0d00-c910-4fcc-a0f9-533978de8a3d]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG os_brick.utils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:00:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:00:04 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:07 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020792.0476966, 7373c6f3-5a7b-4b9a-a8cd-0ea478932321 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:00:07 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] VM Stopped (Lifecycle Event)
Aug 03 00:00:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1441e709-ce3a-4084-b881-3377462e4099 None None] [instance: 7373c6f3-5a7b-4b9a-a8cd-0ea478932321] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:00:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Starting finish_migration {{(pid=72520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance directory exists: not creating {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 00:00:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Creating image(s)
Aug 03 00:00:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'trusted_certs' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk. size=21474836480 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk 21474836480 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk 21474836480" returned: 0 in 0.043s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Ensure instance console log exists: /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Start _get_guest_xml network_info=[{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1100094194-network", "vif_mac": "fa:16:3e:06:61:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '525c1354-331d-4075-95af-df3dae596dba', 'attached_at': '2023-08-03T00:00:10.000000', 'detached_at': '', 'volume_id': 'e0f07ff6-87a1-4e4c-959b-dc2166b860f3', 'serial': 'e0f07ff6-87a1-4e4c-959b-dc2166b860f3'}, 'attachment_id': 'f05c0893-beb4-4eae-b527-0cc9c032fb3a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:00:11 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:00:11 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'vcpu_model' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:00:11 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:00:11 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:00:11 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec84b19b-417b-4ac8-b35a-40356652fbcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:00:11 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08f67f-5e92-4c8b-8650-d4791bbcbbf9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3] added
Aug 03 00:00:11 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66ef420-953c-4f16-ba32-e239ae4730ab]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8279d2c-cc8c-4540-bc70-60d5af098474]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUlaGWbZ {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUlaGWbZ" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f587ad-60ab-43f6-8341-a39523fd84ea]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XUlaGWbZ'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8493403a-8eab-4b51-9529-171feba78d1f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a91505-fc4b-4cc5-be8a-ca202d940c3d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 03 00:00:11 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:11 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 03 00:00:11 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:11 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[266be93b-9255-4cec-abd6-e113dc776ce4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]
Aug 03 00:00:11 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.
Aug 03 00:00:11 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[842b88bb-6ea1-4dab-964b-a0de4cb0a4ae]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fee918-b529-4cd4-9a5d-63ec1d001d26]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 03 00:00:11 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:11 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:11 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 03 00:00:11 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:11 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:11 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2dd5ab-1a56-46f9-b21b-436a9b0766c3]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:00:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:00:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.155872344970703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Applying migration context for instance 525c1354-331d-4075-95af-df3dae596dba as it has an incoming, in-progress migration 607ca200-e25a-4382-93d3-9eb76ded7812. Migration status is post-migrating {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 03 00:00:12 user nova-compute[72520]: INFO nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating resource usage from migration 607ca200-e25a-4382-93d3-9eb76ded7812
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Migration 607ca200-e25a-4382-93d3-9eb76ded7812 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26539643837346563', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539643837346563', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:00:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1100094194-network", "vif_mac": "fa:16:3e:06:61:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1100094194-network", "vif_mac": "fa:16:3e:06:61:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:00:12 user nova-compute[72520]:   <uuid>525c1354-331d-4075-95af-df3dae596dba</uuid>
Aug 03 00:00:12 user nova-compute[72520]:   <name>instance-00000023</name>
Aug 03 00:00:12 user nova-compute[72520]:   <memory>2097152</memory>
Aug 03 00:00:12 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:00:12 user nova-compute[72520]:   <metadata>
Aug 03 00:00:12 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:00:12 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:00:12 user nova-compute[72520]:       <nova:name>tempest-ServerActionsTestOtherB-server-1996012707</nova:name>
Aug 03 00:00:12 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:00:11</nova:creationTime>
Aug 03 00:00:12 user nova-compute[72520]:       <nova:flavor name="m1.small">
Aug 03 00:00:12 user nova-compute[72520]:         <nova:memory>2048</nova:memory>
Aug 03 00:00:12 user nova-compute[72520]:         <nova:disk>20</nova:disk>
Aug 03 00:00:12 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:00:12 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:00:12 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:00:12 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:00:12 user nova-compute[72520]:       <nova:owner>
Aug 03 00:00:12 user nova-compute[72520]:         <nova:user uuid="7575219fc35f44bd9e10cea1089f18c4">tempest-ServerActionsTestOtherB-1849233865-project-member</nova:user>
Aug 03 00:00:12 user nova-compute[72520]:         <nova:project uuid="2d2bc015de264348a271db0a4e6a3615">tempest-ServerActionsTestOtherB-1849233865</nova:project>
Aug 03 00:00:12 user nova-compute[72520]:       </nova:owner>
Aug 03 00:00:12 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:00:12 user nova-compute[72520]:       <nova:ports>
Aug 03 00:00:12 user nova-compute[72520]:         <nova:port uuid="fd871833-3bb6-4119-b904-e27a4440e86b">
Aug 03 00:00:12 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 00:00:12 user nova-compute[72520]:         </nova:port>
Aug 03 00:00:12 user nova-compute[72520]:       </nova:ports>
Aug 03 00:00:12 user nova-compute[72520]:     </nova:instance>
Aug 03 00:00:12 user nova-compute[72520]:   </metadata>
Aug 03 00:00:12 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:00:12 user nova-compute[72520]:     <system>
Aug 03 00:00:12 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:00:12 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:00:12 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:00:12 user nova-compute[72520]:       <entry name="serial">525c1354-331d-4075-95af-df3dae596dba</entry>
Aug 03 00:00:12 user nova-compute[72520]:       <entry name="uuid">525c1354-331d-4075-95af-df3dae596dba</entry>
Aug 03 00:00:12 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:00:12 user nova-compute[72520]:     </system>
Aug 03 00:00:12 user nova-compute[72520]:   </sysinfo>
Aug 03 00:00:12 user nova-compute[72520]:   <os>
Aug 03 00:00:12 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:00:12 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:00:12 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:00:12 user nova-compute[72520]:   </os>
Aug 03 00:00:12 user nova-compute[72520]:   <features>
Aug 03 00:00:12 user nova-compute[72520]:     <acpi/>
Aug 03 00:00:12 user nova-compute[72520]:     <apic/>
Aug 03 00:00:12 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:00:12 user nova-compute[72520]:   </features>
Aug 03 00:00:12 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:00:12 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:00:12 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:00:12 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:00:12 user nova-compute[72520]:   </clock>
Aug 03 00:00:12 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:00:12 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:00:12 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:00:12 user nova-compute[72520]:   </cpu>
Aug 03 00:00:12 user nova-compute[72520]:   <devices>
Aug 03 00:00:12 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:00:12 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:00:12 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk"/>
Aug 03 00:00:12 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:00:12 user nova-compute[72520]:     </disk>
Aug 03 00:00:12 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:00:12 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:00:12 user nova-compute[72520]:       <source dev="/dev/sdd"/>
Aug 03 00:00:12 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 03 00:00:12 user nova-compute[72520]:       <serial>e0f07ff6-87a1-4e4c-959b-dc2166b860f3</serial>
Aug 03 00:00:12 user nova-compute[72520]:     </disk>
Aug 03 00:00:12 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:00:12 user nova-compute[72520]:       <mac address="fa:16:3e:06:61:f1"/>
Aug 03 00:00:12 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:00:12 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:00:12 user nova-compute[72520]:       <target dev="tapfd871833-3b"/>
Aug 03 00:00:12 user nova-compute[72520]:     </interface>
Aug 03 00:00:12 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:00:12 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/console.log" append="off"/>
Aug 03 00:00:12 user nova-compute[72520]:     </serial>
Aug 03 00:00:12 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:00:12 user nova-compute[72520]:     <video>
Aug 03 00:00:12 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:00:12 user nova-compute[72520]:     </video>
Aug 03 00:00:12 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:00:12 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:00:12 user nova-compute[72520]:     </rng>
Aug 03 00:00:12 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:00:12 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:00:12 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:00:12 user nova-compute[72520]:     </memballoon>
Aug 03 00:00:12 user nova-compute[72520]:   </devices>
Aug 03 00:00:12 user nova-compute[72520]: </domain>
Aug 03 00:00:12 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:00:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1100094194-network", "vif_mac": "fa:16:3e:06:61:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1100094194-network", "vif_mac": "fa:16:3e:06:61:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG os_vif [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd871833-3b, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd871833-3b, col_values=(('external_ids', {'iface-id': 'fd871833-3bb6-4119-b904-e27a4440e86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:61:f1', 'vm-uuid': '525c1354-331d-4075-95af-df3dae596dba'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:12 user nova-compute[72520]: INFO os_vif [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b')
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:00:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] No VIF found with MAC fa:16:3e:06:61:f1, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020799.377368, 525c1354-331d-4075-95af-df3dae596dba => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:00:14 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Stopped (Lifecycle Event)
Aug 03 00:00:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1db4ca8f-df28-4085-8c85-387dda5df325 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-f56061fd-b518-496f-8f54-e31b584f3dd5 req-33e37298-4e7e-4405-b0a9-537762098692 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f56061fd-b518-496f-8f54-e31b584f3dd5 req-33e37298-4e7e-4405-b0a9-537762098692 service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f56061fd-b518-496f-8f54-e31b584f3dd5 req-33e37298-4e7e-4405-b0a9-537762098692 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f56061fd-b518-496f-8f54-e31b584f3dd5 req-33e37298-4e7e-4405-b0a9-537762098692 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-f56061fd-b518-496f-8f54-e31b584f3dd5 req-33e37298-4e7e-4405-b0a9-537762098692 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:00:14 user nova-compute[72520]: WARNING nova.compute.manager [req-f56061fd-b518-496f-8f54-e31b584f3dd5 req-33e37298-4e7e-4405-b0a9-537762098692 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state active and task_state resize_finish.
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020816.4245849, 525c1354-331d-4075-95af-df3dae596dba => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:00:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Resumed (Lifecycle Event)
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:00:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance running successfully.
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Failed to set time: agent not configured {{(pid=72520) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f91cc66e-afe0-4ff9-a1bd-cc060346a511 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] finish_migration finished successfully. {{(pid=72520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:00:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020816.4275155, 525c1354-331d-4075-95af-df3dae596dba => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:00:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Started (Lifecycle Event)
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:00:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-ab274ec8-b4b4-45c4-9293-c87cb46b146d req-09ca227e-2277-47a4-87e7-910c5d18dd7d service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ab274ec8-b4b4-45c4-9293-c87cb46b146d req-09ca227e-2277-47a4-87e7-910c5d18dd7d service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ab274ec8-b4b4-45c4-9293-c87cb46b146d req-09ca227e-2277-47a4-87e7-910c5d18dd7d service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ab274ec8-b4b4-45c4-9293-c87cb46b146d req-09ca227e-2277-47a4-87e7-910c5d18dd7d service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-ab274ec8-b4b4-45c4-9293-c87cb46b146d req-09ca227e-2277-47a4-87e7-910c5d18dd7d service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:00:16 user nova-compute[72520]: WARNING nova.compute.manager [req-ab274ec8-b4b4-45c4-9293-c87cb46b146d req-09ca227e-2277-47a4-87e7-910c5d18dd7d service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state resized and task_state None.
Aug 03 00:00:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:17 user nova-compute[72520]: INFO nova.compute.manager [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Detaching volume 9e240b5b-d710-4ed8-b790-f4064cc7244d
Aug 03 00:00:17 user nova-compute[72520]: INFO nova.virt.block_device [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Attempting to driver detach volume 9e240b5b-d710-4ed8-b790-f4064cc7244d from mountpoint /dev/vdc
Aug 03 00:00:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Attempting to detach device vdc from instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:00:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:00:17 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:00:17 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:00:17 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 03 00:00:17 user nova-compute[72520]:   <serial>9e240b5b-d710-4ed8-b790-f4064cc7244d</serial>
Aug 03 00:00:17 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 00:00:17 user nova-compute[72520]: </disk>
Aug 03 00:00:17 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:00:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully detached device vdc from instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c from the persistent domain config.
Aug 03 00:00:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:00:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:00:17 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:00:17 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:00:17 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 03 00:00:17 user nova-compute[72520]:   <serial>9e240b5b-d710-4ed8-b790-f4064cc7244d</serial>
Aug 03 00:00:17 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 00:00:17 user nova-compute[72520]: </disk>
Aug 03 00:00:17 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020818.2092679, 4b47e71c-4d43-4727-97ac-a47ff88b6c2c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:00:18 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully detached device vdc from instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c from the live domain config.
Aug 03 00:00:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjihfYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:00:18 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[94662023-5e1b-48e7-87f3-8dc22d78a1c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d6c9a-c3d1-4b32-a094-de36be501220]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 03 00:00:18 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:18 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d (non-flash)
Aug 03 00:00:18 user nova-compute[72520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:18 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce426f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc98c69-c3d7-43ba-98d5-d2e6a7a4a991]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bdd7d2-31d8-4fc7-bd3b-56c6c8a515c0]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc78b0-9b30-454b-87be-a4ce04551afe]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf88ef7-5e8d-4678-90ab-51190ce504b9]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d83d8d-81f8-459f-bb2d-f2d477806f85]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5099fcc-6359-413a-b437-33029f023752]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260]
Aug 03 00:00:18 user nova-compute[72520]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d, portal: 172.16.0.220,3260] successful.
Aug 03 00:00:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e240b5b-d710-4ed8-b790-f4064cc7244d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[191265f1-070f-4d8e-b9f9-a11911b1e5c9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] <== disconnect_volume: return (298ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:00:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:00:19 user nova-compute[72520]: DEBUG nova.objects.instance [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'flavor' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:00:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-498ea864-9bd3-4dd0-b2cb-9b0523b72338 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.834s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "b663d586-5b67-424b-875a-08a601d9c92a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "b663d586-5b67-424b-875a-08a601d9c92a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:00:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:00:23 user nova-compute[72520]: INFO nova.compute.claims [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Claim successful on node user
Aug 03 00:00:24 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:00:24 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:00:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:00:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:00:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:00:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:00:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:00:24 user nova-compute[72520]: INFO nova.virt.block_device [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Booting with volume snapshot 42d2a9ee-7e06-49bb-ba68-a5dd5ba834ec at /dev/vda
Aug 03 00:00:24 user nova-compute[72520]: DEBUG nova.policy [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f4f73d9df5413590eb77ae2b94090d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a710f41a5a44408a041238b388d588e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Successfully created port: 602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Successfully updated port: 602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "refresh_cache-b663d586-5b67-424b-875a-08a601d9c92a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquired lock "refresh_cache-b663d586-5b67-424b-875a-08a601d9c92a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received event network-changed-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Refreshing instance network info cache due to event network-changed-602c2d59-e80d-43b9-bc6d-f255b946dd47. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] Acquiring lock "refresh_cache-b663d586-5b67-424b-875a-08a601d9c92a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:00:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG nova.network.neutron [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Updating instance_info_cache with network_info: [{"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Releasing lock "refresh_cache-b663d586-5b67-424b-875a-08a601d9c92a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Instance network_info: |[{"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] Acquired lock "refresh_cache-b663d586-5b67-424b-875a-08a601d9c92a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Refreshing network info cache for port 602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Updated VIF entry in instance network info cache for port 602c2d59-e80d-43b9-bc6d-f255b946dd47. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Updating instance_info_cache with network_info: [{"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:00:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f07d4f02-5b76-4a68-b1c9-8d331e2287ed req-456f8531-7508-4c71-9e43-b179fa86f7ef service nova] Releasing lock "refresh_cache-b663d586-5b67-424b-875a-08a601d9c92a" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:00:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG os_brick.utils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c471c2f-96b8-4c63-aba7-05c2265ca9a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c79df40-8a87-4bbd-8574-e25cba3d71a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f8abb-4287-4b89-96c1-6e643759099a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8797509d-bfa6-482a-812f-2d6b3df414a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:00:30 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:00:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f2e0c1-7196-4cb5-9e94-b62af4f8ab8e]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG os_brick.utils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:00:30 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Updating existing volume attachment record: 8414ab9e-2dee-4a88-953e-6d9f00407cbd {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:00:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:00:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:00:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:00:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:00:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:00:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Creating image(s)
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Ensure instance console log exists: /opt/stack/data/nova/instances/b663d586-5b67-424b-875a-08a601d9c92a/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Start _get_guest_xml network_info=[{"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTamBOjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b663d586-5b67-424b-875a-08a601d9c92a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c56adea0-b35b-4a38-b699-15bc89c821fa', 'serial': 'c56adea0-b35b-4a38-b699-15bc89c821fa'}, 'attachment_id': '8414ab9e-2dee-4a88-953e-6d9f00407cbd', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:00:37 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:00:37 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTamBOjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:00:37 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:00:37 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:00:37 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d699aa7b-588c-4821-ab68-0b8f253470bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:00:37 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9810f4-e384-4528-a0e0-910211a92d3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa] added
Aug 03 00:00:37 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce00a62-148c-4d9b-a8ed-6fa4f5c1bc7f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45cc93c-7e04-46f0-895e-9fedd6dae2ba]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTamBOjw {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTamBOjw" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd30632-2cfb-4085-a559-65b632ee042d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTamBOjw'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfcbd7c-fc5b-4aea-a74d-ff506c1cb37a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3442c3-e957-4112-bf6d-0a35072ae5b2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63ecc4e-6088-48b0-866f-1e6ece4a1e78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260]
Aug 03 00:00:38 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260] successful.
Aug 03 00:00:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc88b0-27f2-47e2-82e4-0911de65b169]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19727ba8-01bb-4e6f-9bb5-dfff57d6e380]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:00:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:00:38 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:00:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8337e80-ae52-46eb-9cf6-4f7ad8d7a1db]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:00:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTamBOjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23438643338363762', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438643338363762', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-38801237',display_name='tempest-TestVolumeBootPattern-server-38801237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-38801237',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-3wryonr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:00:24Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=b663d586-5b67-424b-875a-08a601d9c92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:18:6d,bridge_name='br-int',has_traffic_filtering=True,id=602c2d59-e80d-43b9-bc6d-f255b946dd47,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602c2d59-e8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'pci_devices' on Instance uuid b663d586-5b67-424b-875a-08a601d9c92a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:00:39 user nova-compute[72520]:   <uuid>b663d586-5b67-424b-875a-08a601d9c92a</uuid>
Aug 03 00:00:39 user nova-compute[72520]:   <name>instance-00000026</name>
Aug 03 00:00:39 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:00:39 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:00:39 user nova-compute[72520]:   <metadata>
Aug 03 00:00:39 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:00:39 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:00:39 user nova-compute[72520]:       <nova:name>tempest-TestVolumeBootPattern-server-38801237</nova:name>
Aug 03 00:00:39 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:00:37</nova:creationTime>
Aug 03 00:00:39 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:00:39 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:00:39 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:00:39 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:00:39 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:00:39 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:00:39 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:00:39 user nova-compute[72520]:       <nova:owner>
Aug 03 00:00:39 user nova-compute[72520]:         <nova:user uuid="53f4f73d9df5413590eb77ae2b94090d">tempest-TestVolumeBootPattern-1675749395-project-member</nova:user>
Aug 03 00:00:39 user nova-compute[72520]:         <nova:project uuid="4a710f41a5a44408a041238b388d588e">tempest-TestVolumeBootPattern-1675749395</nova:project>
Aug 03 00:00:39 user nova-compute[72520]:       </nova:owner>
Aug 03 00:00:39 user nova-compute[72520]:       <nova:ports>
Aug 03 00:00:39 user nova-compute[72520]:         <nova:port uuid="602c2d59-e80d-43b9-bc6d-f255b946dd47">
Aug 03 00:00:39 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 00:00:39 user nova-compute[72520]:         </nova:port>
Aug 03 00:00:39 user nova-compute[72520]:       </nova:ports>
Aug 03 00:00:39 user nova-compute[72520]:     </nova:instance>
Aug 03 00:00:39 user nova-compute[72520]:   </metadata>
Aug 03 00:00:39 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:00:39 user nova-compute[72520]:     <system>
Aug 03 00:00:39 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:00:39 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:00:39 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:00:39 user nova-compute[72520]:       <entry name="serial">b663d586-5b67-424b-875a-08a601d9c92a</entry>
Aug 03 00:00:39 user nova-compute[72520]:       <entry name="uuid">b663d586-5b67-424b-875a-08a601d9c92a</entry>
Aug 03 00:00:39 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:00:39 user nova-compute[72520]:     </system>
Aug 03 00:00:39 user nova-compute[72520]:   </sysinfo>
Aug 03 00:00:39 user nova-compute[72520]:   <os>
Aug 03 00:00:39 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:00:39 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:00:39 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:00:39 user nova-compute[72520]:   </os>
Aug 03 00:00:39 user nova-compute[72520]:   <features>
Aug 03 00:00:39 user nova-compute[72520]:     <acpi/>
Aug 03 00:00:39 user nova-compute[72520]:     <apic/>
Aug 03 00:00:39 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:00:39 user nova-compute[72520]:   </features>
Aug 03 00:00:39 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:00:39 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:00:39 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:00:39 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:00:39 user nova-compute[72520]:   </clock>
Aug 03 00:00:39 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:00:39 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:00:39 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:00:39 user nova-compute[72520]:   </cpu>
Aug 03 00:00:39 user nova-compute[72520]:   <devices>
Aug 03 00:00:39 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:00:39 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:00:39 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 03 00:00:39 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:00:39 user nova-compute[72520]:       <serial>c56adea0-b35b-4a38-b699-15bc89c821fa</serial>
Aug 03 00:00:39 user nova-compute[72520]:     </disk>
Aug 03 00:00:39 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:00:39 user nova-compute[72520]:       <mac address="fa:16:3e:d4:18:6d"/>
Aug 03 00:00:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:00:39 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:00:39 user nova-compute[72520]:       <target dev="tap602c2d59-e8"/>
Aug 03 00:00:39 user nova-compute[72520]:     </interface>
Aug 03 00:00:39 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:00:39 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/b663d586-5b67-424b-875a-08a601d9c92a/console.log" append="off"/>
Aug 03 00:00:39 user nova-compute[72520]:     </serial>
Aug 03 00:00:39 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:00:39 user nova-compute[72520]:     <video>
Aug 03 00:00:39 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:00:39 user nova-compute[72520]:     </video>
Aug 03 00:00:39 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:00:39 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:00:39 user nova-compute[72520]:     </rng>
Aug 03 00:00:39 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:00:39 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:00:39 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:00:39 user nova-compute[72520]:     </memballoon>
Aug 03 00:00:39 user nova-compute[72520]:   </devices>
Aug 03 00:00:39 user nova-compute[72520]: </domain>
Aug 03 00:00:39 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-38801237',display_name='tempest-TestVolumeBootPattern-server-38801237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-38801237',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-3wryonr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:00:24Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=b663d586-5b67-424b-875a-08a601d9c92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:18:6d,bridge_name='br-int',has_traffic_filtering=True,id=602c2d59-e80d-43b9-bc6d-f255b946dd47,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602c2d59-e8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG os_vif [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:18:6d,bridge_name='br-int',has_traffic_filtering=True,id=602c2d59-e80d-43b9-bc6d-f255b946dd47,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602c2d59-e8') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap602c2d59-e8, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap602c2d59-e8, col_values=(('external_ids', {'iface-id': '602c2d59-e80d-43b9-bc6d-f255b946dd47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:18:6d', 'vm-uuid': 'b663d586-5b67-424b-875a-08a601d9c92a'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:39 user nova-compute[72520]: INFO os_vif [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:18:6d,bridge_name='br-int',has_traffic_filtering=True,id=602c2d59-e80d-43b9-bc6d-f255b946dd47,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602c2d59-e8')
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No VIF found with MAC fa:16:3e:d4:18:6d, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:00:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-fe1f7bf4-2650-4bde-8a7b-26f656f4d615 req-f26e0299-4cda-49f8-b020-1a25e69eb60f service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received event network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fe1f7bf4-2650-4bde-8a7b-26f656f4d615 req-f26e0299-4cda-49f8-b020-1a25e69eb60f service nova] Acquiring lock "b663d586-5b67-424b-875a-08a601d9c92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fe1f7bf4-2650-4bde-8a7b-26f656f4d615 req-f26e0299-4cda-49f8-b020-1a25e69eb60f service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-fe1f7bf4-2650-4bde-8a7b-26f656f4d615 req-f26e0299-4cda-49f8-b020-1a25e69eb60f service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-fe1f7bf4-2650-4bde-8a7b-26f656f4d615 req-f26e0299-4cda-49f8-b020-1a25e69eb60f service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] No waiting events found dispatching network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:00:40 user nova-compute[72520]: WARNING nova.compute.manager [req-fe1f7bf4-2650-4bde-8a7b-26f656f4d615 req-f26e0299-4cda-49f8-b020-1a25e69eb60f service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received unexpected event network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 for instance with vm_state building and task_state spawning.
Aug 03 00:00:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020842.673526, b663d586-5b67-424b-875a-08a601d9c92a => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:00:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] VM Resumed (Lifecycle Event)
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:00:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Instance spawned successfully.
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:00:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020842.6745956, b663d586-5b67-424b-875a-08a601d9c92a => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:00:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] VM Started (Lifecycle Event)
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:00:42 user nova-compute[72520]: INFO nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:00:42 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:00:42 user nova-compute[72520]: INFO nova.compute.manager [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Took 18.89 seconds to build instance.
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-584bddb0-8297-48ff-b9c3-45fc13606cdf req-197d9a3e-7606-4694-b496-003bf2962378 service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received event network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-584bddb0-8297-48ff-b9c3-45fc13606cdf req-197d9a3e-7606-4694-b496-003bf2962378 service nova] Acquiring lock "b663d586-5b67-424b-875a-08a601d9c92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-584bddb0-8297-48ff-b9c3-45fc13606cdf req-197d9a3e-7606-4694-b496-003bf2962378 service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-584bddb0-8297-48ff-b9c3-45fc13606cdf req-197d9a3e-7606-4694-b496-003bf2962378 service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-584bddb0-8297-48ff-b9c3-45fc13606cdf req-197d9a3e-7606-4694-b496-003bf2962378 service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] No waiting events found dispatching network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:00:42 user nova-compute[72520]: WARNING nova.compute.manager [req-584bddb0-8297-48ff-b9c3-45fc13606cdf req-197d9a3e-7606-4694-b496-003bf2962378 service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received unexpected event network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 for instance with vm_state active and task_state None.
Aug 03 00:00:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-193ecb2e-8a31-470e-942e-1d6dda707202 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "b663d586-5b67-424b-875a-08a601d9c92a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.981s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-changed-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Refreshing instance network info cache due to event network-changed-3158f43d-a8c5-491d-b239-dda5a2a4b980. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] Acquiring lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] Acquired lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Refreshing network info cache for port 3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:50 user nova-compute[72520]: INFO nova.compute.manager [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Terminating instance
Aug 03 00:00:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updated VIF entry in instance network info cache for port 3158f43d-a8c5-491d-b239-dda5a2a4b980. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [{"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:00:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-005d177b-5fba-4c7f-a83b-aacaea4e5bd2 req-844354d6-2ef8-4d13-9b8f-de580e3b5bd5 service nova] Releasing lock "refresh_cache-0fa3db91-fd75-47e6-bce0-f612e5afe5c0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:00:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Instance destroyed successfully.
Aug 03 00:00:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lazy-loading 'resources' on Instance uuid 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-532068730',display_name='tempest-TestStampPattern-server-532068730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-532068730',id=32,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfr+fZTq73vPqi3KD8xg6zCQNhY3yvgp2jBtELhyFONrVCY4fZPONJM5IwmbDaDaDReMtv/cCmZk6EIIRiMsEWdetIL8IFplnshiRssnbg415aZgohbu0Rd9qgWXAMv6g==',key_name='tempest-TestStampPattern-2115296246',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:53:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0c4d33b6caa44d6945a836e0b19ba10',ramdisk_id='',reservation_id='r-m3m98nu3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-163390428',owner_user_name='tempest-TestStampPattern-163390428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:56:50Z,user_data=None,user_id='333b602f3a894e4e84db31594de293c7',uuid=0fa3db91-fd75-47e6-bce0-f612e5afe5c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converting VIF {"id": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "address": "fa:16:3e:d5:a9:a0", "network": {"id": "83672aeb-6245-42a7-a246-f2a48f81b664", "bridge": "br-int", "label": "tempest-TestStampPattern-1449531426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0c4d33b6caa44d6945a836e0b19ba10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158f43d-a8", "ovs_interfaceid": "3158f43d-a8c5-491d-b239-dda5a2a4b980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a9:a0,bridge_name='br-int',has_traffic_filtering=True,id=3158f43d-a8c5-491d-b239-dda5a2a4b980,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3158f43d-a8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG os_vif [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a9:a0,bridge_name='br-int',has_traffic_filtering=True,id=3158f43d-a8c5-491d-b239-dda5a2a4b980,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3158f43d-a8') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3158f43d-a8, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:51 user nova-compute[72520]: INFO os_vif [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a9:a0,bridge_name='br-int',has_traffic_filtering=True,id=3158f43d-a8c5-491d-b239-dda5a2a4b980,network=Network(83672aeb-6245-42a7-a246-f2a48f81b664),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3158f43d-a8')
Aug 03 00:00:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Deleting instance files /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0_del
Aug 03 00:00:51 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Deletion of /opt/stack/data/nova/instances/0fa3db91-fd75-47e6-bce0-f612e5afe5c0_del complete
Aug 03 00:00:51 user nova-compute[72520]: INFO nova.compute.manager [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 03 00:00:51 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:00:51 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-2eddd539-9979-450e-950c-e80661121cca req-12c2ba5c-980a-4eb5-a6a4-b2e35ea61b77 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-vif-deleted-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:52 user nova-compute[72520]: INFO nova.compute.manager [req-2eddd539-9979-450e-950c-e80661121cca req-12c2ba5c-980a-4eb5-a6a4-b2e35ea61b77 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Neutron deleted interface 3158f43d-a8c5-491d-b239-dda5a2a4b980; detaching it from the instance and deleting it from the info cache
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.network.neutron [req-2eddd539-9979-450e-950c-e80661121cca req-12c2ba5c-980a-4eb5-a6a4-b2e35ea61b77 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:00:52 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Took 0.84 seconds to deallocate network for instance.
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-2eddd539-9979-450e-950c-e80661121cca req-12c2ba5c-980a-4eb5-a6a4-b2e35ea61b77 service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Detach interface failed, port_id=3158f43d-a8c5-491d-b239-dda5a2a4b980, reason: Instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-vif-unplugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] No waiting events found dispatching network-vif-unplugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:00:52 user nova-compute[72520]: WARNING nova.compute.manager [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received unexpected event network-vif-unplugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 for instance with vm_state deleted and task_state None.
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received event network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] Acquiring lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] No waiting events found dispatching network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:00:52 user nova-compute[72520]: WARNING nova.compute.manager [req-ae42b0b2-e808-4ef0-a4a7-2f92f7d60acd req-c93af681-44c0-4d1f-b7a7-adfe4586d6bf service nova] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Received unexpected event network-vif-plugged-3158f43d-a8c5-491d-b239-dda5a2a4b980 for instance with vm_state deleted and task_state None.
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:52 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Deleted allocations for instance 0fa3db91-fd75-47e6-bce0-f612e5afe5c0
Aug 03 00:00:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d012b4b8-53a5-43f3-bd52-0a6be04d5879 tempest-TestStampPattern-163390428 tempest-TestStampPattern-163390428-project-member] Lock "0fa3db91-fd75-47e6-bce0-f612e5afe5c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:00:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:00:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020851.1322877, 0fa3db91-fd75-47e6-bce0-f612e5afe5c0 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:01:06 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] VM Stopped (Lifecycle Event)
Aug 03 00:01:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-fa605a1d-0af1-47b2-9bb6-cbf5e7fe7857 None None] [instance: 0fa3db91-fd75-47e6-bce0-f612e5afe5c0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [{"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-4b47e71c-4d43-4727-97ac-a47ff88b6c2c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:01:06 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:08 user nova-compute[72520]: INFO nova.compute.manager [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Terminating instance
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-57b85318-b9b9-4809-857a-b3d58d2084ba req-c5fc34f1-eadd-4c58-b8a6-d0c403276053 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-unplugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-57b85318-b9b9-4809-857a-b3d58d2084ba req-c5fc34f1-eadd-4c58-b8a6-d0c403276053 service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-57b85318-b9b9-4809-857a-b3d58d2084ba req-c5fc34f1-eadd-4c58-b8a6-d0c403276053 service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-57b85318-b9b9-4809-857a-b3d58d2084ba req-c5fc34f1-eadd-4c58-b8a6-d0c403276053 service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-57b85318-b9b9-4809-857a-b3d58d2084ba req-c5fc34f1-eadd-4c58-b8a6-d0c403276053 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-unplugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-57b85318-b9b9-4809-857a-b3d58d2084ba req-c5fc34f1-eadd-4c58-b8a6-d0c403276053 service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-unplugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:01:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Instance destroyed successfully.
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'resources' on Instance uuid 4b47e71c-4d43-4727-97ac-a47ff88b6c2c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-02T23:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1538732641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1538732641',id=34,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpaQd+V9/52J/QBVoJW+fu0jc4kF0cPPPSztdB4k+LP+O+3cZpKkqQ5qYL8SzbR8hSWHhqV0zC/blRoXw0fsZks6XShfvKnjJSjMzqg8by6uOc80nv5oxz4bni5jbYZvA==',key_name='tempest-keypair-641100772',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:58:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-4ofkuknn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=4b47e71c-4d43-4727-97ac-a47ff88b6c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "address": "fa:16:3e:e3:9d:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb2a1afa-6a", "ovs_interfaceid": "cb2a1afa-6a4f-4e19-bd5f-6255baa05956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG os_vif [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb2a1afa-6a, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:08 user nova-compute[72520]: INFO os_vif [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb2a1afa-6a')
Aug 03 00:01:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Deleting instance files /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c_del
Aug 03 00:01:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Deletion of /opt/stack/data/nova/instances/4b47e71c-4d43-4727-97ac-a47ff88b6c2c_del complete
Aug 03 00:01:08 user nova-compute[72520]: INFO nova.compute.manager [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:01:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:09 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:01:09 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Took 0.85 seconds to deallocate network for instance.
Aug 03 00:01:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-f463cbc0-eaaa-42fd-b7b6-0e3ffc905445 req-f31df59c-577e-477d-a0e1-83a2e65e07fd service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-deleted-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:01:09 user nova-compute[72520]: INFO nova.compute.manager [req-f463cbc0-eaaa-42fd-b7b6-0e3ffc905445 req-f31df59c-577e-477d-a0e1-83a2e65e07fd service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Neutron deleted interface cb2a1afa-6a4f-4e19-bd5f-6255baa05956; detaching it from the instance and deleting it from the info cache
Aug 03 00:01:09 user nova-compute[72520]: DEBUG nova.network.neutron [req-f463cbc0-eaaa-42fd-b7b6-0e3ffc905445 req-f31df59c-577e-477d-a0e1-83a2e65e07fd service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:01:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-f463cbc0-eaaa-42fd-b7b6-0e3ffc905445 req-f31df59c-577e-477d-a0e1-83a2e65e07fd service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Detach interface failed, port_id=cb2a1afa-6a4f-4e19-bd5f-6255baa05956, reason: Instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:01:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:09 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:10 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Deleted allocations for instance 4b47e71c-4d43-4727-97ac-a47ff88b6c2c
Aug 03 00:01:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8069d7e1-4574-4e67-9f5b-7dbc6c2d34dd tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-b6e523de-ae98-45de-b979-bd51c0adb6f6 req-f6d479f9-1339-4769-bfab-c5b58833929e service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b6e523de-ae98-45de-b979-bd51c0adb6f6 req-f6d479f9-1339-4769-bfab-c5b58833929e service nova] Acquiring lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b6e523de-ae98-45de-b979-bd51c0adb6f6 req-f6d479f9-1339-4769-bfab-c5b58833929e service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b6e523de-ae98-45de-b979-bd51c0adb6f6 req-f6d479f9-1339-4769-bfab-c5b58833929e service nova] Lock "4b47e71c-4d43-4727-97ac-a47ff88b6c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-b6e523de-ae98-45de-b979-bd51c0adb6f6 req-f6d479f9-1339-4769-bfab-c5b58833929e service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] No waiting events found dispatching network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:01:10 user nova-compute[72520]: WARNING nova.compute.manager [req-b6e523de-ae98-45de-b979-bd51c0adb6f6 req-f6d479f9-1339-4769-bfab-c5b58833929e service nova] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Received unexpected event network-vif-plugged-cb2a1afa-6a4f-4e19-bd5f-6255baa05956 for instance with vm_state deleted and task_state None.
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:01:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:01:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=25.305526733398438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Applying migration context for instance 525c1354-331d-4075-95af-df3dae596dba as it has an incoming, in-progress migration 607ca200-e25a-4382-93d3-9eb76ded7812. Migration status is finished {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 03 00:01:12 user nova-compute[72520]: INFO nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating resource usage from migration 607ca200-e25a-4382-93d3-9eb76ded7812
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Migration 607ca200-e25a-4382-93d3-9eb76ded7812 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b663d586-5b67-424b-875a-08a601d9c92a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=22GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:01:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquired lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'info_cache' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Releasing lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:01:17 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance destroyed successfully.
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'resources' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_vif [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap571c58f6-40, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:01:17 user nova-compute[72520]: INFO os_vif [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40')
Aug 03 00:01:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoANTYrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:01:17 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a6980-3c67-4771-bb4a-095d8b4290dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5811f-2edd-442a-bea0-fbeb821e1c95]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:17 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:17 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:17 user nova-compute[72520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:17 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:17 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce42b7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:01:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b2216-ed78-456c-8854-fbaae8d8b83d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176f41e-1553-4629-a309-e95988bec0a7]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ec3e0c-063d-4e1c-9041-9bc02cfdd46d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[53116ff6-adbd-408e-b854-c52ef20f3c3e]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fd7d3e-b631-494e-be1c-a7d3449bba64]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4dddd-2689-4fb7-b35d-a73aa78129b8]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]
Aug 03 00:01:18 user nova-compute[72520]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.
Aug 03 00:01:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afceb13-734b-4614-ae0c-8de812627190]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== disconnect_volume: return (246ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Start _get_guest_xml network_info=[{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoANTYrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0ada24d4-91f7-4d2f-bd25-6c226d313331', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddaa4491-23a1-4b9c-b1ee-e485594a73f3', 'serial': 'ddaa4491-23a1-4b9c-b1ee-e485594a73f3'}, 'attachment_id': '5f016ebc-9d07-4541-8972-17510b6c1d59', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:01:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoANTYrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:01:18 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:01:18 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:01:18 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da63ef-5eac-4e2e-9d56-c8031eb5eea0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:01:18 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91cab51-fa46-4773-b166-0bc1fcd27fec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3] added
Aug 03 00:01:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27b25c-e748-46ce-9000-d2de6d0051fa]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a7f69b-9d6b-4d66-a920-2848ee2a6623]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoANTYrB {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoANTYrB" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eb6323-87d8-4280-89ef-60ffadfcf071]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoANTYrB'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abda13d-4d02-4318-b36e-869396452727]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0777e7d0-3b8f-4220-80bb-74afdd95621d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:18 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:18 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83415eb8-e339-4860-a28b-b1cfde01c302]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]
Aug 03 00:01:18 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.
Aug 03 00:01:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c6ee19-6f5d-4a91-911a-8d43cfa9c17e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9d4228-6ea5-422c-8b23-fe911ac3563c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:18 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:18 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:18 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:18 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:18 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42db506-f295-42e8-a334-0f55f5d60738]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:18 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoANTYrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26636663739343862', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663739343862', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-02T23:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:01:19 user nova-compute[72520]:   <uuid>0ada24d4-91f7-4d2f-bd25-6c226d313331</uuid>
Aug 03 00:01:19 user nova-compute[72520]:   <name>instance-00000025</name>
Aug 03 00:01:19 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:01:19 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:01:19 user nova-compute[72520]:   <metadata>
Aug 03 00:01:19 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:01:19 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:01:19 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeTestJSON-server-548410330</nova:name>
Aug 03 00:01:19 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:01:18</nova:creationTime>
Aug 03 00:01:19 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:01:19 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:01:19 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:01:19 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:01:19 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:01:19 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:01:19 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:01:19 user nova-compute[72520]:       <nova:owner>
Aug 03 00:01:19 user nova-compute[72520]:         <nova:user uuid="7ce27b8383604c46ab82b2af76c7e26b">tempest-AttachVolumeTestJSON-2114655012-project-member</nova:user>
Aug 03 00:01:19 user nova-compute[72520]:         <nova:project uuid="e4088b685db6408fa8b3231fa95405e7">tempest-AttachVolumeTestJSON-2114655012</nova:project>
Aug 03 00:01:19 user nova-compute[72520]:       </nova:owner>
Aug 03 00:01:19 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:01:19 user nova-compute[72520]:       <nova:ports>
Aug 03 00:01:19 user nova-compute[72520]:         <nova:port uuid="571c58f6-401f-4632-916d-646803b6f25f">
Aug 03 00:01:19 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 03 00:01:19 user nova-compute[72520]:         </nova:port>
Aug 03 00:01:19 user nova-compute[72520]:       </nova:ports>
Aug 03 00:01:19 user nova-compute[72520]:     </nova:instance>
Aug 03 00:01:19 user nova-compute[72520]:   </metadata>
Aug 03 00:01:19 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:01:19 user nova-compute[72520]:     <system>
Aug 03 00:01:19 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:01:19 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:01:19 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:01:19 user nova-compute[72520]:       <entry name="serial">0ada24d4-91f7-4d2f-bd25-6c226d313331</entry>
Aug 03 00:01:19 user nova-compute[72520]:       <entry name="uuid">0ada24d4-91f7-4d2f-bd25-6c226d313331</entry>
Aug 03 00:01:19 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:01:19 user nova-compute[72520]:     </system>
Aug 03 00:01:19 user nova-compute[72520]:   </sysinfo>
Aug 03 00:01:19 user nova-compute[72520]:   <os>
Aug 03 00:01:19 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:01:19 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:01:19 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:01:19 user nova-compute[72520]:   </os>
Aug 03 00:01:19 user nova-compute[72520]:   <features>
Aug 03 00:01:19 user nova-compute[72520]:     <acpi/>
Aug 03 00:01:19 user nova-compute[72520]:     <apic/>
Aug 03 00:01:19 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:01:19 user nova-compute[72520]:   </features>
Aug 03 00:01:19 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:01:19 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:01:19 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:01:19 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:01:19 user nova-compute[72520]:   </clock>
Aug 03 00:01:19 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:01:19 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:01:19 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:01:19 user nova-compute[72520]:   </cpu>
Aug 03 00:01:19 user nova-compute[72520]:   <devices>
Aug 03 00:01:19 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:01:19 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:01:19 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk"/>
Aug 03 00:01:19 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:01:19 user nova-compute[72520]:     </disk>
Aug 03 00:01:19 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:01:19 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:01:19 user nova-compute[72520]:       <source dev="/dev/sdc"/>
Aug 03 00:01:19 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 03 00:01:19 user nova-compute[72520]:       <serial>ddaa4491-23a1-4b9c-b1ee-e485594a73f3</serial>
Aug 03 00:01:19 user nova-compute[72520]:     </disk>
Aug 03 00:01:19 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:01:19 user nova-compute[72520]:       <mac address="fa:16:3e:8a:9e:16"/>
Aug 03 00:01:19 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:01:19 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:01:19 user nova-compute[72520]:       <target dev="tap571c58f6-40"/>
Aug 03 00:01:19 user nova-compute[72520]:     </interface>
Aug 03 00:01:19 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:01:19 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/console.log" append="off"/>
Aug 03 00:01:19 user nova-compute[72520]:     </serial>
Aug 03 00:01:19 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:01:19 user nova-compute[72520]:     <video>
Aug 03 00:01:19 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:01:19 user nova-compute[72520]:     </video>
Aug 03 00:01:19 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:01:19 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:01:19 user nova-compute[72520]:     </rng>
Aug 03 00:01:19 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:01:19 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:01:19 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:01:19 user nova-compute[72520]:     </memballoon>
Aug 03 00:01:19 user nova-compute[72520]:   </devices>
Aug 03 00:01:19 user nova-compute[72520]: </domain>
Aug 03 00:01:19 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Cannot resize image /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'migration_context' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-02T23:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG os_vif [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap571c58f6-40, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap571c58f6-40, col_values=(('external_ids', {'iface-id': '571c58f6-401f-4632-916d-646803b6f25f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:9e:16', 'vm-uuid': '0ada24d4-91f7-4d2f-bd25-6c226d313331'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:01:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:20 user nova-compute[72520]: INFO os_vif [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40')
Aug 03 00:01:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-c5720dc2-014e-4039-ae24-91ee31266055 req-6bda57ac-9793-4410-8b7e-9187d4d6e7fb service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c5720dc2-014e-4039-ae24-91ee31266055 req-6bda57ac-9793-4410-8b7e-9187d4d6e7fb service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c5720dc2-014e-4039-ae24-91ee31266055 req-6bda57ac-9793-4410-8b7e-9187d4d6e7fb service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c5720dc2-014e-4039-ae24-91ee31266055 req-6bda57ac-9793-4410-8b7e-9187d4d6e7fb service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-c5720dc2-014e-4039-ae24-91ee31266055 req-6bda57ac-9793-4410-8b7e-9187d4d6e7fb service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:01:21 user nova-compute[72520]: WARNING nova.compute.manager [req-c5720dc2-014e-4039-ae24-91ee31266055 req-6bda57ac-9793-4410-8b7e-9187d4d6e7fb service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state stopped and task_state powering-on.
Aug 03 00:01:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020883.686734, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:01:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Resumed (Lifecycle Event)
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:01:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance rebooted successfully.
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1a4a81bf-5835-4ee2-897c-a6ddb1a559d0 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:01:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020883.6885424, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:01:23 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Started (Lifecycle Event)
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020868.803501, 4b47e71c-4d43-4727-97ac-a47ff88b6c2c => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:01:23 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] VM Stopped (Lifecycle Event)
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-93d560d8-e4a9-4a3c-aaa0-48a5e3d347c7 None None] [instance: 4b47e71c-4d43-4727-97ac-a47ff88b6c2c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-3488f6df-8d3e-49c8-b07b-db8d7a9192cd req-cdde2da5-1ea8-43c9-b9b9-22ad62c6c548 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3488f6df-8d3e-49c8-b07b-db8d7a9192cd req-cdde2da5-1ea8-43c9-b9b9-22ad62c6c548 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3488f6df-8d3e-49c8-b07b-db8d7a9192cd req-cdde2da5-1ea8-43c9-b9b9-22ad62c6c548 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3488f6df-8d3e-49c8-b07b-db8d7a9192cd req-cdde2da5-1ea8-43c9-b9b9-22ad62c6c548 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:23 user nova-compute[72520]: DEBUG nova.compute.manager [req-3488f6df-8d3e-49c8-b07b-db8d7a9192cd req-cdde2da5-1ea8-43c9-b9b9-22ad62c6c548 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:01:23 user nova-compute[72520]: WARNING nova.compute.manager [req-3488f6df-8d3e-49c8-b07b-db8d7a9192cd req-cdde2da5-1ea8-43c9-b9b9-22ad62c6c548 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state active and task_state None.
Aug 03 00:01:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:01:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:01:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:01:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:01:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:01:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:01:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:01:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:01:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Port fd871833-3bb6-4119-b904-e27a4440e86b binding to destination host user is already ACTIVE {{(pid=72520) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 03 00:01:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:01:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:01:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:01:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:01:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:01:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Creating tmpfile /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/tmp76fenlbe to verify with other compute node that the instance is on the same shared storage. {{(pid=72520) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG nova.compute.manager [req-8876b20c-8f2c-4078-b2e9-ed988ca14764 req-e47ece1d-db85-4428-a431-8bc21f75cf03 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8876b20c-8f2c-4078-b2e9-ed988ca14764 req-e47ece1d-db85-4428-a431-8bc21f75cf03 service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8876b20c-8f2c-4078-b2e9-ed988ca14764 req-e47ece1d-db85-4428-a431-8bc21f75cf03 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8876b20c-8f2c-4078-b2e9-ed988ca14764 req-e47ece1d-db85-4428-a431-8bc21f75cf03 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG nova.compute.manager [req-8876b20c-8f2c-4078-b2e9-ed988ca14764 req-e47ece1d-db85-4428-a431-8bc21f75cf03 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:01:48 user nova-compute[72520]: WARNING nova.compute.manager [req-8876b20c-8f2c-4078-b2e9-ed988ca14764 req-e47ece1d-db85-4428-a431-8bc21f75cf03 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state resized and task_state resize_reverting.
Aug 03 00:01:48 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance destroyed successfully.
Aug 03 00:01:48 user nova-compute[72520]: DEBUG nova.objects.instance [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'resources' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_vif [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd871833-3b, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:01:48 user nova-compute[72520]: INFO os_vif [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b')
Aug 03 00:01:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:01:48 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa1ba5a-e7cf-4ac1-ae13-5f74abfc3a64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e37bda-dcdb-49a2-8706-9ad3fb2a9b10]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:48 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:48 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:48 user nova-compute[72520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:48 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:48 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d0a6a6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf8a6d0-1a49-42d8-85ee-70c3e03360e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[522a8302-5053-47d3-a6e7-6a7ce0ca5747]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf86c71d-77c7-4019-9ef3-1dded6260f26]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee07a7bc-0f2b-4aa6-a899-1b3b78ff1996]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced3b1b3-bb43-4c7b-a551-fada2ddcd22e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1337e398-eb00-4b93-b880-142ca30400a8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]
Aug 03 00:01:49 user nova-compute[72520]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.
Aug 03 00:01:49 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e0c98-5cbf-4e6d-80d3-ef447c0195d1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== disconnect_volume: return (277ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:01:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG nova.objects.instance [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'migration_context' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-725cf3ed-4719-4e42-ba0f-08d4a706bc76 req-53ddfb95-b69c-4db6-a308-93158553bdf8 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-725cf3ed-4719-4e42-ba0f-08d4a706bc76 req-53ddfb95-b69c-4db6-a308-93158553bdf8 service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-725cf3ed-4719-4e42-ba0f-08d4a706bc76 req-53ddfb95-b69c-4db6-a308-93158553bdf8 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-725cf3ed-4719-4e42-ba0f-08d4a706bc76 req-53ddfb95-b69c-4db6-a308-93158553bdf8 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-725cf3ed-4719-4e42-ba0f-08d4a706bc76 req-53ddfb95-b69c-4db6-a308-93158553bdf8 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:01:50 user nova-compute[72520]: WARNING nova.compute.manager [req-725cf3ed-4719-4e42-ba0f-08d4a706bc76 req-53ddfb95-b69c-4db6-a308-93158553bdf8 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state resized and task_state resize_reverting.
Aug 03 00:01:50 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.244s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:01:50 user nova-compute[72520]: INFO nova.compute.manager [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Swapping old allocation on dict_keys(['34a01f3b-1fb2-4503-8766-a057bea6ed6a']) held by migration 607ca200-e25a-4382-93d3-9eb76ded7812 for instance
Aug 03 00:01:50 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Overwriting current allocation {'allocations': {'34a01f3b-1fb2-4503-8766-a057bea6ed6a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 47}}, 'project_id': '2d2bc015de264348a271db0a4e6a3615', 'user_id': '7575219fc35f44bd9e10cea1089f18c4', 'consumer_generation': 1} on consumer 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:01:50 user nova-compute[72520]: DEBUG nova.network.neutron [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG nova.network.neutron [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG os_brick.utils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd59b6-ca30-4ebf-94b2-9626a82ad9dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dff0d9-9841-468e-ba86-39452b1861c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090bbb7-8857-43dc-b92f-03bd35287398]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002a1cf-eedb-44cc-9cd9-fe410b94c08c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:01:51 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:01:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335fd14-dca7-4dd8-b5df-42ad12d5307e]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:01:51 user nova-compute[72520]: DEBUG os_brick.utils [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:01:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Starting finish_revert_migration {{(pid=72520) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Start _get_guest_xml network_info=[{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '525c1354-331d-4075-95af-df3dae596dba', 'attached_at': '2023-08-03T00:01:59.000000', 'detached_at': '', 'volume_id': 'e0f07ff6-87a1-4e4c-959b-dc2166b860f3', 'serial': 'e0f07ff6-87a1-4e4c-959b-dc2166b860f3'}, 'attachment_id': '22e936f3-4a63-4646-9d50-33f92b19e7d5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:01:59 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:01:59 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.objects.instance [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'vcpu_model' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:01:59 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:01:59 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:01:59 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[681061d6-3994-4638-92e1-e967f89d408b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:01:59 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47facce-b91c-4450-a55e-450240fdd334]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3] added
Aug 03 00:01:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0ff9f-eec8-4969-905b-0fffc2c415d5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4a65c-5968-48e9-af09-7f017b52de41]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUlaGWbZ {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUlaGWbZ" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ab78d1-8107-45e9-a05c-fc1a0a09bb72]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XUlaGWbZ'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8da9bbc-79ce-46f8-9789-cb3fb89366f9]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3c3494-6ef5-4ab5-9bde-ecbca832cc8d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:59 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:59 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d57db8c-88a9-443e-bed2-87afdb7de9bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]
Aug 03 00:01:59 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.
Aug 03 00:01:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac6b0b-79f1-447e-bf59-53c7d2afdca3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d5b2e8-6182-4a83-9c54-f199c49a709a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:59 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:59 user nova-compute[72520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:01:59 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:01:59 user nova-compute[72520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:01:59 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e79874-7bd4-4929-8fd8-7bb617f7d9df]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:01:59 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26539643837346563', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539643837346563', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:02:00 user nova-compute[72520]:   <uuid>525c1354-331d-4075-95af-df3dae596dba</uuid>
Aug 03 00:02:00 user nova-compute[72520]:   <name>instance-00000023</name>
Aug 03 00:02:00 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:02:00 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:02:00 user nova-compute[72520]:   <metadata>
Aug 03 00:02:00 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:02:00 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:02:00 user nova-compute[72520]:       <nova:name>tempest-ServerActionsTestOtherB-server-1996012707</nova:name>
Aug 03 00:02:00 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:01:59</nova:creationTime>
Aug 03 00:02:00 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:02:00 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:02:00 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:02:00 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:02:00 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:02:00 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:02:00 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:02:00 user nova-compute[72520]:       <nova:owner>
Aug 03 00:02:00 user nova-compute[72520]:         <nova:user uuid="7575219fc35f44bd9e10cea1089f18c4">tempest-ServerActionsTestOtherB-1849233865-project-member</nova:user>
Aug 03 00:02:00 user nova-compute[72520]:         <nova:project uuid="2d2bc015de264348a271db0a4e6a3615">tempest-ServerActionsTestOtherB-1849233865</nova:project>
Aug 03 00:02:00 user nova-compute[72520]:       </nova:owner>
Aug 03 00:02:00 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:02:00 user nova-compute[72520]:       <nova:ports>
Aug 03 00:02:00 user nova-compute[72520]:         <nova:port uuid="fd871833-3bb6-4119-b904-e27a4440e86b">
Aug 03 00:02:00 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 00:02:00 user nova-compute[72520]:         </nova:port>
Aug 03 00:02:00 user nova-compute[72520]:       </nova:ports>
Aug 03 00:02:00 user nova-compute[72520]:     </nova:instance>
Aug 03 00:02:00 user nova-compute[72520]:   </metadata>
Aug 03 00:02:00 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:02:00 user nova-compute[72520]:     <system>
Aug 03 00:02:00 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:02:00 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:02:00 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:02:00 user nova-compute[72520]:       <entry name="serial">525c1354-331d-4075-95af-df3dae596dba</entry>
Aug 03 00:02:00 user nova-compute[72520]:       <entry name="uuid">525c1354-331d-4075-95af-df3dae596dba</entry>
Aug 03 00:02:00 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:02:00 user nova-compute[72520]:     </system>
Aug 03 00:02:00 user nova-compute[72520]:   </sysinfo>
Aug 03 00:02:00 user nova-compute[72520]:   <os>
Aug 03 00:02:00 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:02:00 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:02:00 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:02:00 user nova-compute[72520]:   </os>
Aug 03 00:02:00 user nova-compute[72520]:   <features>
Aug 03 00:02:00 user nova-compute[72520]:     <acpi/>
Aug 03 00:02:00 user nova-compute[72520]:     <apic/>
Aug 03 00:02:00 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:02:00 user nova-compute[72520]:   </features>
Aug 03 00:02:00 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:02:00 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:02:00 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:02:00 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:02:00 user nova-compute[72520]:   </clock>
Aug 03 00:02:00 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:02:00 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:02:00 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:02:00 user nova-compute[72520]:   </cpu>
Aug 03 00:02:00 user nova-compute[72520]:   <devices>
Aug 03 00:02:00 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:02:00 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:02:00 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk"/>
Aug 03 00:02:00 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:02:00 user nova-compute[72520]:     </disk>
Aug 03 00:02:00 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:02:00 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:02:00 user nova-compute[72520]:       <source dev="/dev/sdd"/>
Aug 03 00:02:00 user nova-compute[72520]:       <target dev="vdb" bus="virtio"/>
Aug 03 00:02:00 user nova-compute[72520]:       <serial>e0f07ff6-87a1-4e4c-959b-dc2166b860f3</serial>
Aug 03 00:02:00 user nova-compute[72520]:     </disk>
Aug 03 00:02:00 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:02:00 user nova-compute[72520]:       <mac address="fa:16:3e:06:61:f1"/>
Aug 03 00:02:00 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:02:00 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:02:00 user nova-compute[72520]:       <target dev="tapfd871833-3b"/>
Aug 03 00:02:00 user nova-compute[72520]:     </interface>
Aug 03 00:02:00 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:02:00 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/console.log" append="off"/>
Aug 03 00:02:00 user nova-compute[72520]:     </serial>
Aug 03 00:02:00 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:02:00 user nova-compute[72520]:     <video>
Aug 03 00:02:00 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:02:00 user nova-compute[72520]:     </video>
Aug 03 00:02:00 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:02:00 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:02:00 user nova-compute[72520]:     </rng>
Aug 03 00:02:00 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:02:00 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:02:00 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:02:00 user nova-compute[72520]:     </memballoon>
Aug 03 00:02:00 user nova-compute[72520]:   </devices>
Aug 03 00:02:00 user nova-compute[72520]: </domain>
Aug 03 00:02:00 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG os_vif [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd871833-3b, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd871833-3b, col_values=(('external_ids', {'iface-id': 'fd871833-3bb6-4119-b904-e27a4440e86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:61:f1', 'vm-uuid': '525c1354-331d-4075-95af-df3dae596dba'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:02:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:00 user nova-compute[72520]: INFO os_vif [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b')
Aug 03 00:02:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:02:02 user nova-compute[72520]: INFO nova.compute.claims [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Claim successful on node user
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-2f918593-3068-4fcf-9877-7da459dc9318 req-4505b0d3-ca79-45d9-83e7-e780a966f756 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2f918593-3068-4fcf-9877-7da459dc9318 req-4505b0d3-ca79-45d9-83e7-e780a966f756 service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2f918593-3068-4fcf-9877-7da459dc9318 req-4505b0d3-ca79-45d9-83e7-e780a966f756 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2f918593-3068-4fcf-9877-7da459dc9318 req-4505b0d3-ca79-45d9-83e7-e780a966f756 service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-2f918593-3068-4fcf-9877-7da459dc9318 req-4505b0d3-ca79-45d9-83e7-e780a966f756 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:02:02 user nova-compute[72520]: WARNING nova.compute.manager [req-2f918593-3068-4fcf-9877-7da459dc9318 req-4505b0d3-ca79-45d9-83e7-e780a966f756 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state resized and task_state resize_reverting.
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.network.neutron [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:02:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:02:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Creating image(s)
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG nova.policy [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f9ec64c4b24430e8f7ee755a9f37806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16f380acff84d95b2bfb049709f4246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:02:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk 1073741824" returned: 0 in 0.056s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Cannot resize image /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.objects.instance [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'migration_context' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Ensure instance console log exists: /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.network.neutron [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Successfully created port: 307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020908.7593446, 525c1354-331d-4075-95af-df3dae596dba => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:02:03 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Stopped (Lifecycle Event)
Aug 03 00:02:03 user nova-compute[72520]: DEBUG nova.compute.manager [None req-72bd586c-37b7-464d-9340-7733b1ac6776 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020924.3281434, 525c1354-331d-4075-95af-df3dae596dba => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:02:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Resumed (Lifecycle Event)
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:02:04 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance running successfully.
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] finish_revert_migration finished successfully. {{(pid=72520) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:02:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020924.3292181, 525c1354-331d-4075-95af-df3dae596dba => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:02:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Started (Lifecycle Event)
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-a9112e2a-3ec2-481f-a300-843b09345d25 req-b8af0f98-be8d-4c33-b6d3-5b6d3bcff9ce service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a9112e2a-3ec2-481f-a300-843b09345d25 req-b8af0f98-be8d-4c33-b6d3-5b6d3bcff9ce service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a9112e2a-3ec2-481f-a300-843b09345d25 req-b8af0f98-be8d-4c33-b6d3-5b6d3bcff9ce service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a9112e2a-3ec2-481f-a300-843b09345d25 req-b8af0f98-be8d-4c33-b6d3-5b6d3bcff9ce service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-a9112e2a-3ec2-481f-a300-843b09345d25 req-b8af0f98-be8d-4c33-b6d3-5b6d3bcff9ce service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:02:04 user nova-compute[72520]: WARNING nova.compute.manager [req-a9112e2a-3ec2-481f-a300-843b09345d25 req-b8af0f98-be8d-4c33-b6d3-5b6d3bcff9ce service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state resized and task_state resize_reverting.
Aug 03 00:02:04 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 03 00:02:04 user nova-compute[72520]: INFO nova.compute.manager [None req-be32136f-4cc9-4300-9b32-e6fd6b48665b tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance to original state: 'active'
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Successfully updated port: 307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing instance network info cache due to event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:02:04 user nova-compute[72520]: DEBUG nova.network.neutron [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance network_info: |[{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Start _get_guest_xml network_info=[{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:02:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:02:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-813989366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-813989366',id=39,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOmR/vYtBy+44PEK18LBiLVP4SfwyCoBYyzF9CCAe5biZLu7Q3tKyTmIJfQ54qDGG7YF6UdJ9vbqEj27iRDYkhnBvsl6AeJq6+yUR213VX5p35b96ZnDK+sXpBuFiZSLw==',key_name='tempest-keypair-396377392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-av5s58ey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=f3a7f181-b3b8-4688-a50a-3ecd6911a731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.objects.instance [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'pci_devices' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:02:05 user nova-compute[72520]:   <uuid>f3a7f181-b3b8-4688-a50a-3ecd6911a731</uuid>
Aug 03 00:02:05 user nova-compute[72520]:   <name>instance-00000027</name>
Aug 03 00:02:05 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:02:05 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:02:05 user nova-compute[72520]:   <metadata>
Aug 03 00:02:05 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:02:05 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:02:05 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-813989366</nova:name>
Aug 03 00:02:05 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:02:05</nova:creationTime>
Aug 03 00:02:05 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:02:05 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:02:05 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:02:05 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:02:05 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:02:05 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:02:05 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:02:05 user nova-compute[72520]:       <nova:owner>
Aug 03 00:02:05 user nova-compute[72520]:         <nova:user uuid="4f9ec64c4b24430e8f7ee755a9f37806">tempest-AttachVolumeShelveTestJSON-952018091-project-member</nova:user>
Aug 03 00:02:05 user nova-compute[72520]:         <nova:project uuid="a16f380acff84d95b2bfb049709f4246">tempest-AttachVolumeShelveTestJSON-952018091</nova:project>
Aug 03 00:02:05 user nova-compute[72520]:       </nova:owner>
Aug 03 00:02:05 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:02:05 user nova-compute[72520]:       <nova:ports>
Aug 03 00:02:05 user nova-compute[72520]:         <nova:port uuid="307b5527-bbe8-434e-874c-7eca23941f5e">
Aug 03 00:02:05 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 03 00:02:05 user nova-compute[72520]:         </nova:port>
Aug 03 00:02:05 user nova-compute[72520]:       </nova:ports>
Aug 03 00:02:05 user nova-compute[72520]:     </nova:instance>
Aug 03 00:02:05 user nova-compute[72520]:   </metadata>
Aug 03 00:02:05 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:02:05 user nova-compute[72520]:     <system>
Aug 03 00:02:05 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:02:05 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:02:05 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:02:05 user nova-compute[72520]:       <entry name="serial">f3a7f181-b3b8-4688-a50a-3ecd6911a731</entry>
Aug 03 00:02:05 user nova-compute[72520]:       <entry name="uuid">f3a7f181-b3b8-4688-a50a-3ecd6911a731</entry>
Aug 03 00:02:05 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:02:05 user nova-compute[72520]:     </system>
Aug 03 00:02:05 user nova-compute[72520]:   </sysinfo>
Aug 03 00:02:05 user nova-compute[72520]:   <os>
Aug 03 00:02:05 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:02:05 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:02:05 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:02:05 user nova-compute[72520]:   </os>
Aug 03 00:02:05 user nova-compute[72520]:   <features>
Aug 03 00:02:05 user nova-compute[72520]:     <acpi/>
Aug 03 00:02:05 user nova-compute[72520]:     <apic/>
Aug 03 00:02:05 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:02:05 user nova-compute[72520]:   </features>
Aug 03 00:02:05 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:02:05 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:02:05 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:02:05 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:02:05 user nova-compute[72520]:   </clock>
Aug 03 00:02:05 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:02:05 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:02:05 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:02:05 user nova-compute[72520]:   </cpu>
Aug 03 00:02:05 user nova-compute[72520]:   <devices>
Aug 03 00:02:05 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:02:05 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:02:05 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk"/>
Aug 03 00:02:05 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:02:05 user nova-compute[72520]:     </disk>
Aug 03 00:02:05 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:02:05 user nova-compute[72520]:       <mac address="fa:16:3e:41:cf:06"/>
Aug 03 00:02:05 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:02:05 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:02:05 user nova-compute[72520]:       <target dev="tap307b5527-bb"/>
Aug 03 00:02:05 user nova-compute[72520]:     </interface>
Aug 03 00:02:05 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:02:05 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/console.log" append="off"/>
Aug 03 00:02:05 user nova-compute[72520]:     </serial>
Aug 03 00:02:05 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:02:05 user nova-compute[72520]:     <video>
Aug 03 00:02:05 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:02:05 user nova-compute[72520]:     </video>
Aug 03 00:02:05 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:02:05 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:02:05 user nova-compute[72520]:     </rng>
Aug 03 00:02:05 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:02:05 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:02:05 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:02:05 user nova-compute[72520]:     </memballoon>
Aug 03 00:02:05 user nova-compute[72520]:   </devices>
Aug 03 00:02:05 user nova-compute[72520]: </domain>
Aug 03 00:02:05 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-813989366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-813989366',id=39,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOmR/vYtBy+44PEK18LBiLVP4SfwyCoBYyzF9CCAe5biZLu7Q3tKyTmIJfQ54qDGG7YF6UdJ9vbqEj27iRDYkhnBvsl6AeJq6+yUR213VX5p35b96ZnDK+sXpBuFiZSLw==',key_name='tempest-keypair-396377392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-av5s58ey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=f3a7f181-b3b8-4688-a50a-3ecd6911a731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG os_vif [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap307b5527-bb, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap307b5527-bb, col_values=(('external_ids', {'iface-id': '307b5527-bbe8-434e-874c-7eca23941f5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:cf:06', 'vm-uuid': 'f3a7f181-b3b8-4688-a50a-3ecd6911a731'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:05 user nova-compute[72520]: INFO os_vif [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb')
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No VIF found with MAC fa:16:3e:41:cf:06, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updated VIF entry in instance network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG nova.network.neutron [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:02:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3eaeb126-a30a-49ad-908c-0c8a72a24477 req-ab62d12e-03a1-4763-a2fa-6858e4ecabec service nova] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-01136cc5-23c4-4976-94a1-c37d97912295 req-0eeb96da-9d5d-47fa-8e95-2194a9ed5b27 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-01136cc5-23c4-4976-94a1-c37d97912295 req-0eeb96da-9d5d-47fa-8e95-2194a9ed5b27 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-01136cc5-23c4-4976-94a1-c37d97912295 req-0eeb96da-9d5d-47fa-8e95-2194a9ed5b27 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-01136cc5-23c4-4976-94a1-c37d97912295 req-0eeb96da-9d5d-47fa-8e95-2194a9ed5b27 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-01136cc5-23c4-4976-94a1-c37d97912295 req-0eeb96da-9d5d-47fa-8e95-2194a9ed5b27 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:02:06 user nova-compute[72520]: WARNING nova.compute.manager [req-01136cc5-23c4-4976-94a1-c37d97912295 req-0eeb96da-9d5d-47fa-8e95-2194a9ed5b27 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state building and task_state spawning.
Aug 03 00:02:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:07 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:02:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:02:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:02:07 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-1c37d55f-d2f3-42e0-88e2-860149bc1cfe req-15c2721d-43ed-41d3-b372-3c148a918ee6 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1c37d55f-d2f3-42e0-88e2-860149bc1cfe req-15c2721d-43ed-41d3-b372-3c148a918ee6 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1c37d55f-d2f3-42e0-88e2-860149bc1cfe req-15c2721d-43ed-41d3-b372-3c148a918ee6 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1c37d55f-d2f3-42e0-88e2-860149bc1cfe req-15c2721d-43ed-41d3-b372-3c148a918ee6 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-1c37d55f-d2f3-42e0-88e2-860149bc1cfe req-15c2721d-43ed-41d3-b372-3c148a918ee6 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:02:08 user nova-compute[72520]: WARNING nova.compute.manager [req-1c37d55f-d2f3-42e0-88e2-860149bc1cfe req-15c2721d-43ed-41d3-b372-3c148a918ee6 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state building and task_state spawning.
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020928.8491971, f3a7f181-b3b8-4688-a50a-3ecd6911a731 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:02:08 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] VM Resumed (Lifecycle Event)
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:02:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance spawned successfully.
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:02:08 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691020928.8504405, f3a7f181-b3b8-4688-a50a-3ecd6911a731 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:02:08 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] VM Started (Lifecycle Event)
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:02:08 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:02:08 user nova-compute[72520]: INFO nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 03 00:02:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:02:09 user nova-compute[72520]: INFO nova.compute.manager [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Took 6.77 seconds to build instance.
Aug 03 00:02:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-58c57af1-8d48-4332-aa51-a5bd574a1415 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.880s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:09 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:09 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 00:02:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:02:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:02:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8319MB free_disk=25.313812255859375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance b663d586-5b67-424b-875a-08a601d9c92a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f3a7f181-b3b8-4688-a50a-3ecd6911a731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:02:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:02:13 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:02:13 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:02:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:02:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 00:02:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "b663d586-5b67-424b-875a-08a601d9c92a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "b663d586-5b67-424b-875a-08a601d9c92a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "b663d586-5b67-424b-875a-08a601d9c92a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:14 user nova-compute[72520]: INFO nova.compute.manager [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Terminating instance
Aug 03 00:02:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-1933690d-8a61-415e-8474-5d28878ff0ea req-92c91017-4469-4974-88ae-f3fe048cbc1e service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received event network-vif-unplugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1933690d-8a61-415e-8474-5d28878ff0ea req-92c91017-4469-4974-88ae-f3fe048cbc1e service nova] Acquiring lock "b663d586-5b67-424b-875a-08a601d9c92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1933690d-8a61-415e-8474-5d28878ff0ea req-92c91017-4469-4974-88ae-f3fe048cbc1e service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1933690d-8a61-415e-8474-5d28878ff0ea req-92c91017-4469-4974-88ae-f3fe048cbc1e service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-1933690d-8a61-415e-8474-5d28878ff0ea req-92c91017-4469-4974-88ae-f3fe048cbc1e service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] No waiting events found dispatching network-vif-unplugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:02:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-1933690d-8a61-415e-8474-5d28878ff0ea req-92c91017-4469-4974-88ae-f3fe048cbc1e service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received event network-vif-unplugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:15 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Instance destroyed successfully.
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.objects.instance [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'resources' on Instance uuid b663d586-5b67-424b-875a-08a601d9c92a {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-38801237',display_name='tempest-TestVolumeBootPattern-server-38801237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-38801237',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-3wryonr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:00:43Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=b663d586-5b67-424b-875a-08a601d9c92a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "address": "fa:16:3e:d4:18:6d", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602c2d59-e8", "ovs_interfaceid": "602c2d59-e80d-43b9-bc6d-f255b946dd47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:18:6d,bridge_name='br-int',has_traffic_filtering=True,id=602c2d59-e80d-43b9-bc6d-f255b946dd47,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602c2d59-e8') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_vif [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:18:6d,bridge_name='br-int',has_traffic_filtering=True,id=602c2d59-e80d-43b9-bc6d-f255b946dd47,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602c2d59-e8') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap602c2d59-e8, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:02:15 user nova-compute[72520]: INFO os_vif [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:18:6d,bridge_name='br-int',has_traffic_filtering=True,id=602c2d59-e80d-43b9-bc6d-f255b946dd47,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602c2d59-e8')
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTamBOjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:02:15 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae2c471-56d1-40dd-9a3d-b80c0d6302c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2eb77c-1ca0-4952-8420-e11f5ac2c82a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:02:15 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:02:15 user nova-compute[72520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:02:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa (non-flash)
Aug 03 00:02:15 user nova-compute[72520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:02:15 user nova-compute[72520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:02:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce41df9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e51ef-6fd2-49a8-8ee9-6d915d583668]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[395863c2-4153-402f-b89f-56e09e822b1f]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c9fb64-10dd-4d80-8615-2ff7ef684c5c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93803ab9-e884-42ea-8343-13b354d0dfb5]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6f510ecf-48d3867bd173d536', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6f510ecf', '/dev/disk/by-id/scsi-23438643338363762') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[41701c78-948d-4921-adeb-97c139875ca9]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b710be8-8987-46cb-bfb0-34c172f3f1c8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a1868c-772e-4098-9036-2f9b2fda17f9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260]
Aug 03 00:02:15 user nova-compute[72520]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa, portal: 172.16.0.220,3260] successful.
Aug 03 00:02:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56adea0-b35b-4a38-b699-15bc89c821fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c424ac34-64ae-4816-9f7f-8163d8c5218c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== disconnect_volume: return (279ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:02:15 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Deleting instance files /opt/stack/data/nova/instances/b663d586-5b67-424b-875a-08a601d9c92a_del
Aug 03 00:02:15 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Deletion of /opt/stack/data/nova/instances/b663d586-5b67-424b-875a-08a601d9c92a_del complete
Aug 03 00:02:15 user nova-compute[72520]: INFO nova.compute.manager [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 03 00:02:15 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:02:15 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b663d586-5b67-424b-875a-08a601d9c92a] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:02:16 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:02:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-cd195ff8-c62b-438b-aa5d-a0ea5ba25c64 req-386589fb-7e98-42c8-90e3-5eb220ce7a0b service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received event network-vif-deleted-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:16 user nova-compute[72520]: INFO nova.compute.manager [req-cd195ff8-c62b-438b-aa5d-a0ea5ba25c64 req-386589fb-7e98-42c8-90e3-5eb220ce7a0b service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Neutron deleted interface 602c2d59-e80d-43b9-bc6d-f255b946dd47; detaching it from the instance and deleting it from the info cache
Aug 03 00:02:16 user nova-compute[72520]: DEBUG nova.network.neutron [req-cd195ff8-c62b-438b-aa5d-a0ea5ba25c64 req-386589fb-7e98-42c8-90e3-5eb220ce7a0b service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:02:16 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Took 0.60 seconds to deallocate network for instance.
Aug 03 00:02:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-cd195ff8-c62b-438b-aa5d-a0ea5ba25c64 req-386589fb-7e98-42c8-90e3-5eb220ce7a0b service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Detach interface failed, port_id=602c2d59-e80d-43b9-bc6d-f255b946dd47, reason: Instance b663d586-5b67-424b-875a-08a601d9c92a could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:02:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-60b1ffe5-8d59-4c11-bd96-76aeccf25003 req-80ce76d8-8737-4bc7-bf29-ee1acd848784 service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received event network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:02:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-60b1ffe5-8d59-4c11-bd96-76aeccf25003 req-80ce76d8-8737-4bc7-bf29-ee1acd848784 service nova] Acquiring lock "b663d586-5b67-424b-875a-08a601d9c92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-60b1ffe5-8d59-4c11-bd96-76aeccf25003 req-80ce76d8-8737-4bc7-bf29-ee1acd848784 service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-60b1ffe5-8d59-4c11-bd96-76aeccf25003 req-80ce76d8-8737-4bc7-bf29-ee1acd848784 service nova] Lock "b663d586-5b67-424b-875a-08a601d9c92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-60b1ffe5-8d59-4c11-bd96-76aeccf25003 req-80ce76d8-8737-4bc7-bf29-ee1acd848784 service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] No waiting events found dispatching network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:02:16 user nova-compute[72520]: WARNING nova.compute.manager [req-60b1ffe5-8d59-4c11-bd96-76aeccf25003 req-80ce76d8-8737-4bc7-bf29-ee1acd848784 service nova] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Received unexpected event network-vif-plugged-602c2d59-e80d-43b9-bc6d-f255b946dd47 for instance with vm_state active and task_state deleting.
Aug 03 00:02:17 user nova-compute[72520]: INFO nova.compute.manager [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Took 0.80 seconds to detach 1 volumes for instance.
Aug 03 00:02:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Deleting volume: c56adea0-b35b-4a38-b699-15bc89c821fa {{(pid=72520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 00:02:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:02:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:02:17 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:02:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:02:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:17 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Deleted allocations for instance b663d586-5b67-424b-875a-08a601d9c92a
Aug 03 00:02:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-6c5cc2ae-439f-4168-9717-f856615e411d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "b663d586-5b67-424b-875a-08a601d9c92a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.027s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:02:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:30 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020935.3638241, b663d586-5b67-424b-875a-08a601d9c92a => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:02:30 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: b663d586-5b67-424b-875a-08a601d9c92a] VM Stopped (Lifecycle Event)
Aug 03 00:02:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f2b38be1-7b26-45c1-9f54-1caba7c9d4c6 None None] [instance: b663d586-5b67-424b-875a-08a601d9c92a] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:02:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:02:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:02:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:03:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:03:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:07 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:08 user nova-compute[72520]: INFO nova.compute.manager [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Detaching volume ddaa4491-23a1-4b9c-b1ee-e485594a73f3
Aug 03 00:03:08 user nova-compute[72520]: INFO nova.virt.block_device [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Attempting to driver detach volume ddaa4491-23a1-4b9c-b1ee-e485594a73f3 from mountpoint /dev/vdb
Aug 03 00:03:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Attempting to detach device vdb from instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:03:08 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:03:08 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 03 00:03:08 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:03:08 user nova-compute[72520]:   <serial>ddaa4491-23a1-4b9c-b1ee-e485594a73f3</serial>
Aug 03 00:03:08 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 00:03:08 user nova-compute[72520]: </disk>
Aug 03 00:03:08 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:03:08 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully detached device vdb from instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 from the persistent domain config.
Aug 03 00:03:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:03:08 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:03:08 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:03:08 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 03 00:03:08 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:03:08 user nova-compute[72520]:   <serial>ddaa4491-23a1-4b9c-b1ee-e485594a73f3</serial>
Aug 03 00:03:08 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 00:03:08 user nova-compute[72520]: </disk>
Aug 03 00:03:08 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691020989.396679, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:03:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully detached device vdb from instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 from the live domain config.
Aug 03 00:03:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoANTYrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:03:09 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06758c5-ea44-43c5-865c-e495d5bb9c8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[90480a66-0d3a-499e-98f3-cbd394d5b1aa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:03:09 user nova-compute[72520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:03:09 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 (non-flash)
Aug 03 00:03:09 user nova-compute[72520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:03:09 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc122320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bdad28-7951-497c-97df-dff4c0873c50]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3596ca14-1ce1-44b6-9c64-d55ed5e1beaf]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eac5a6-f9c3-4d83-8d9b-4d5ed8cb4aa1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b1298-43ae-4379-b9aa-627d06dd5fb8]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83342049-8ef2-45cf-b46c-3ec2d985f68b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db8541f-be55-4696-a8ea-5321ac5b1465]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260]
Aug 03 00:03:09 user nova-compute[72520]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3, portal: 172.16.0.220,3260] successful.
Aug 03 00:03:09 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaa4491-23a1-4b9c-b1ee-e485594a73f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3cd877-fdbb-4341-b51a-e478ac365cda]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== disconnect_volume: return (255ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:03:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:03:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:03:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7c089a2b-aaae-43f1-b118-7f63af8aa58d tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40301551-57d0-45c0-b7b6-6010a7e04fa9 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40301551-57d0-45c0-b7b6-6010a7e04fa9 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-40301551-57d0-45c0-b7b6-6010a7e04fa9 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-40301551-57d0-45c0-b7b6-6010a7e04fa9 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72520) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-40301551-57d0-45c0-b7b6-6010a7e04fa9 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-4b818f05-b12c-452a-ae5e-5069d54deae7 req-52b235f1-4376-4eca-8a62-47ca13aa7b0b service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4b818f05-b12c-452a-ae5e-5069d54deae7 req-52b235f1-4376-4eca-8a62-47ca13aa7b0b service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4b818f05-b12c-452a-ae5e-5069d54deae7 req-52b235f1-4376-4eca-8a62-47ca13aa7b0b service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4b818f05-b12c-452a-ae5e-5069d54deae7 req-52b235f1-4376-4eca-8a62-47ca13aa7b0b service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-4b818f05-b12c-452a-ae5e-5069d54deae7 req-52b235f1-4376-4eca-8a62-47ca13aa7b0b service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:03:11 user nova-compute[72520]: WARNING nova.compute.manager [req-4b818f05-b12c-452a-ae5e-5069d54deae7 req-52b235f1-4376-4eca-8a62-47ca13aa7b0b service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state active and task_state powering-off.
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:03:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance destroyed successfully.
Aug 03 00:03:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-40301551-57d0-45c0-b7b6-6010a7e04fa9 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-40301551-57d0-45c0-b7b6-6010a7e04fa9 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.990s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:13 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:03:13 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=25.284626007080078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-08ed78c4-0773-48aa-857c-040372e73efa req-3fc5f8bc-27f0-47d7-bd7d-1bc5d22367c7 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08ed78c4-0773-48aa-857c-040372e73efa req-3fc5f8bc-27f0-47d7-bd7d-1bc5d22367c7 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08ed78c4-0773-48aa-857c-040372e73efa req-3fc5f8bc-27f0-47d7-bd7d-1bc5d22367c7 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-08ed78c4-0773-48aa-857c-040372e73efa req-3fc5f8bc-27f0-47d7-bd7d-1bc5d22367c7 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-08ed78c4-0773-48aa-857c-040372e73efa req-3fc5f8bc-27f0-47d7-bd7d-1bc5d22367c7 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:03:13 user nova-compute[72520]: WARNING nova.compute.manager [req-08ed78c4-0773-48aa-857c-040372e73efa req-3fc5f8bc-27f0-47d7-bd7d-1bc5d22367c7 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state stopped and task_state None.
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f3a7f181-b3b8-4688-a50a-3ecd6911a731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:03:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:03:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:03:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:03:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:03:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:03:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:03:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "2954a414-3633-4279-a326-092e1eef2256" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:03:22 user nova-compute[72520]: INFO nova.compute.claims [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Claim successful on node user
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:03:22 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:03:22 user nova-compute[72520]: INFO nova.virt.block_device [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Booting with volume cc31712a-0655-491b-a85c-219a26ad690e at /dev/vda
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.policy [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f4f73d9df5413590eb77ae2b94090d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a710f41a5a44408a041238b388d588e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG os_brick.utils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5972907c-8cc9-43cf-9d5e-e0f93924dbcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7858df-4c01-435e-857e-77bd174ffd65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac0848-0d50-4161-90e3-03e59600d49e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07211004-a9b9-4a52-a2c6-bde8318aa00e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:03:22 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:03:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[324afc3d-4914-4760-8dab-7ad57e0f3bf7]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG os_brick.utils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:03:22 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updating existing volume attachment record: b04b0d79-9765-4f5e-b055-2d0823cfaa9d {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:03:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Successfully created port: 7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:03:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Successfully updated port: 7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquired lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-changed-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Refreshing instance network info cache due to event network-changed-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] Acquiring lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updating instance_info_cache with network_info: [{"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Releasing lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Instance network_info: |[{"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] Acquired lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Refreshing network info cache for port 7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updated VIF entry in instance network info cache for port 7efb6cb9-bc2d-4af7-8a96-9cc91f279cef. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG nova.network.neutron [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updating instance_info_cache with network_info: [{"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:03:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1526e487-0cac-4a01-9883-833c875b1d62 req-b1bb337c-b0c1-434f-8011-91305c0aad25 service nova] Releasing lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:03:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:27 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691020992.0048015, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:03:27 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Stopped (Lifecycle Event)
Aug 03 00:03:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e820dec4-917f-4b9d-b6c2-6f2335e7b6c8 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:03:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e820dec4-917f-4b9d-b6c2-6f2335e7b6c8 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:03:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Creating image(s)
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Ensure instance console log exists: /opt/stack/data/nova/instances/2954a414-3633-4279-a326-092e1eef2256/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Start _get_guest_xml network_info=[{"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucWIfrND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2954a414-3633-4279-a326-092e1eef2256', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc31712a-0655-491b-a85c-219a26ad690e', 'serial': 'cc31712a-0655-491b-a85c-219a26ad690e'}, 'attachment_id': 'b04b0d79-9765-4f5e-b055-2d0823cfaa9d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:03:30 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:03:30 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucWIfrND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:03:30 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:03:30 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:03:30 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8527b0e-0f95-4a43-a4dc-e48176a62361]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:03:30 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa12f16e-4ff5-4e62-8266-073ddffbd6ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e] added
Aug 03 00:03:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1845daf9-d5d7-4db2-8e08-3edac4cf0fdf]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05fef2f-99b4-4e55-9bce-2332e869790a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucWIfrND {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucWIfrND" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0339b-d945-4c29-af50-5a30eb4d5247]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucWIfrND'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[402fbda6-83ed-43cc-a96e-3042875d8ad4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b5c79e-ca07-460c-93a9-4a3ffba91374]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:03:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:03:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e70c29-96ba-44ff-8b56-6fe76c63b1d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260]
Aug 03 00:03:30 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260] successful.
Aug 03 00:03:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e18ab7-3e8e-480a-a89b-7bd39cf6cdc7]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6180d48-a0c4-4464-af59-9a54106987d2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:03:30 user nova-compute[72520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:03:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:03:30 user nova-compute[72520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:03:30 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[af90b84e-1f0f-45c9-baeb-32c4e0cb49d4]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:03:30 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucWIfrND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26161663738396335', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161663738396335', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1259732456',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1259732456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1259732456',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwdgn2Qga1Y/v9K3xD4Zz+loZG05DbZg4mDhKQfvYTMrvWDcbq88RQspbc/issAd83Q+R03d2uN7RMe4wFbn0Itqk+g4oqosTxhtQ+SiBbY5xTGvvf4q5rl1LKh9RRlZA==',key_name='tempest-keypair-528872614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-29d0vu5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=2954a414-3633-4279-a326-092e1eef2256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:14:dc,bridge_name='br-int',has_traffic_filtering=True,id=7efb6cb9-bc2d-4af7-8a96-9cc91f279cef,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7efb6cb9-bc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.objects.instance [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'pci_devices' on Instance uuid 2954a414-3633-4279-a326-092e1eef2256 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:03:31 user nova-compute[72520]:   <uuid>2954a414-3633-4279-a326-092e1eef2256</uuid>
Aug 03 00:03:31 user nova-compute[72520]:   <name>instance-00000028</name>
Aug 03 00:03:31 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:03:31 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:03:31 user nova-compute[72520]:   <metadata>
Aug 03 00:03:31 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:03:31 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:03:31 user nova-compute[72520]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1259732456</nova:name>
Aug 03 00:03:31 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:03:30</nova:creationTime>
Aug 03 00:03:31 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:03:31 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:03:31 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:03:31 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:03:31 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:03:31 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:03:31 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:03:31 user nova-compute[72520]:       <nova:owner>
Aug 03 00:03:31 user nova-compute[72520]:         <nova:user uuid="53f4f73d9df5413590eb77ae2b94090d">tempest-TestVolumeBootPattern-1675749395-project-member</nova:user>
Aug 03 00:03:31 user nova-compute[72520]:         <nova:project uuid="4a710f41a5a44408a041238b388d588e">tempest-TestVolumeBootPattern-1675749395</nova:project>
Aug 03 00:03:31 user nova-compute[72520]:       </nova:owner>
Aug 03 00:03:31 user nova-compute[72520]:       <nova:ports>
Aug 03 00:03:31 user nova-compute[72520]:         <nova:port uuid="7efb6cb9-bc2d-4af7-8a96-9cc91f279cef">
Aug 03 00:03:31 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 00:03:31 user nova-compute[72520]:         </nova:port>
Aug 03 00:03:31 user nova-compute[72520]:       </nova:ports>
Aug 03 00:03:31 user nova-compute[72520]:     </nova:instance>
Aug 03 00:03:31 user nova-compute[72520]:   </metadata>
Aug 03 00:03:31 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:03:31 user nova-compute[72520]:     <system>
Aug 03 00:03:31 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:03:31 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:03:31 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:03:31 user nova-compute[72520]:       <entry name="serial">2954a414-3633-4279-a326-092e1eef2256</entry>
Aug 03 00:03:31 user nova-compute[72520]:       <entry name="uuid">2954a414-3633-4279-a326-092e1eef2256</entry>
Aug 03 00:03:31 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:03:31 user nova-compute[72520]:     </system>
Aug 03 00:03:31 user nova-compute[72520]:   </sysinfo>
Aug 03 00:03:31 user nova-compute[72520]:   <os>
Aug 03 00:03:31 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:03:31 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:03:31 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:03:31 user nova-compute[72520]:   </os>
Aug 03 00:03:31 user nova-compute[72520]:   <features>
Aug 03 00:03:31 user nova-compute[72520]:     <acpi/>
Aug 03 00:03:31 user nova-compute[72520]:     <apic/>
Aug 03 00:03:31 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:03:31 user nova-compute[72520]:   </features>
Aug 03 00:03:31 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:03:31 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:03:31 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:03:31 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:03:31 user nova-compute[72520]:   </clock>
Aug 03 00:03:31 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:03:31 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:03:31 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:03:31 user nova-compute[72520]:   </cpu>
Aug 03 00:03:31 user nova-compute[72520]:   <devices>
Aug 03 00:03:31 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:03:31 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:03:31 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 03 00:03:31 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:03:31 user nova-compute[72520]:       <serial>cc31712a-0655-491b-a85c-219a26ad690e</serial>
Aug 03 00:03:31 user nova-compute[72520]:     </disk>
Aug 03 00:03:31 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:03:31 user nova-compute[72520]:       <mac address="fa:16:3e:58:14:dc"/>
Aug 03 00:03:31 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:03:31 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:03:31 user nova-compute[72520]:       <target dev="tap7efb6cb9-bc"/>
Aug 03 00:03:31 user nova-compute[72520]:     </interface>
Aug 03 00:03:31 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:03:31 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/2954a414-3633-4279-a326-092e1eef2256/console.log" append="off"/>
Aug 03 00:03:31 user nova-compute[72520]:     </serial>
Aug 03 00:03:31 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:03:31 user nova-compute[72520]:     <video>
Aug 03 00:03:31 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:03:31 user nova-compute[72520]:     </video>
Aug 03 00:03:31 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:03:31 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:03:31 user nova-compute[72520]:     </rng>
Aug 03 00:03:31 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:03:31 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:03:31 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:03:31 user nova-compute[72520]:     </memballoon>
Aug 03 00:03:31 user nova-compute[72520]:   </devices>
Aug 03 00:03:31 user nova-compute[72520]: </domain>
Aug 03 00:03:31 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1259732456',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1259732456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1259732456',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwdgn2Qga1Y/v9K3xD4Zz+loZG05DbZg4mDhKQfvYTMrvWDcbq88RQspbc/issAd83Q+R03d2uN7RMe4wFbn0Itqk+g4oqosTxhtQ+SiBbY5xTGvvf4q5rl1LKh9RRlZA==',key_name='tempest-keypair-528872614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-29d0vu5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=2954a414-3633-4279-a326-092e1eef2256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:14:dc,bridge_name='br-int',has_traffic_filtering=True,id=7efb6cb9-bc2d-4af7-8a96-9cc91f279cef,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7efb6cb9-bc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG os_vif [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:14:dc,bridge_name='br-int',has_traffic_filtering=True,id=7efb6cb9-bc2d-4af7-8a96-9cc91f279cef,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7efb6cb9-bc') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7efb6cb9-bc, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7efb6cb9-bc, col_values=(('external_ids', {'iface-id': '7efb6cb9-bc2d-4af7-8a96-9cc91f279cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:14:dc', 'vm-uuid': '2954a414-3633-4279-a326-092e1eef2256'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:31 user nova-compute[72520]: INFO os_vif [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:14:dc,bridge_name='br-int',has_traffic_filtering=True,id=7efb6cb9-bc2d-4af7-8a96-9cc91f279cef,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7efb6cb9-bc')
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:03:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No VIF found with MAC fa:16:3e:58:14:dc, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:03:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-8e0e5e04-8103-49d4-9e22-d856cba994d1 req-f48a8dc9-6319-4b3a-9e3c-1036fc4e4d84 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8e0e5e04-8103-49d4-9e22-d856cba994d1 req-f48a8dc9-6319-4b3a-9e3c-1036fc4e4d84 service nova] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8e0e5e04-8103-49d4-9e22-d856cba994d1 req-f48a8dc9-6319-4b3a-9e3c-1036fc4e4d84 service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8e0e5e04-8103-49d4-9e22-d856cba994d1 req-f48a8dc9-6319-4b3a-9e3c-1036fc4e4d84 service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-8e0e5e04-8103-49d4-9e22-d856cba994d1 req-f48a8dc9-6319-4b3a-9e3c-1036fc4e4d84 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] No waiting events found dispatching network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:03:33 user nova-compute[72520]: WARNING nova.compute.manager [req-8e0e5e04-8103-49d4-9e22-d856cba994d1 req-f48a8dc9-6319-4b3a-9e3c-1036fc4e4d84 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received unexpected event network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef for instance with vm_state building and task_state spawning.
Aug 03 00:03:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021014.9458647, 2954a414-3633-4279-a326-092e1eef2256 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:03:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] VM Resumed (Lifecycle Event)
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:03:34 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 2954a414-3633-4279-a326-092e1eef2256] Instance spawned successfully.
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:03:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:03:34 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021014.9500022, 2954a414-3633-4279-a326-092e1eef2256 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:03:34 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] VM Started (Lifecycle Event)
Aug 03 00:03:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:03:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:03:35 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:03:35 user nova-compute[72520]: INFO nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 03 00:03:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:03:35 user nova-compute[72520]: INFO nova.compute.manager [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Took 12.89 seconds to build instance.
Aug 03 00:03:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-25f8907a-4ae6-4200-ad1c-8bd051ddbd38 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "2954a414-3633-4279-a326-092e1eef2256" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.983s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-115aab16-2815-4bee-8da1-bfbaf3ccb0c0 req-3c60f595-1bec-464f-9286-7bcecb951edc service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:03:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-115aab16-2815-4bee-8da1-bfbaf3ccb0c0 req-3c60f595-1bec-464f-9286-7bcecb951edc service nova] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-115aab16-2815-4bee-8da1-bfbaf3ccb0c0 req-3c60f595-1bec-464f-9286-7bcecb951edc service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-115aab16-2815-4bee-8da1-bfbaf3ccb0c0 req-3c60f595-1bec-464f-9286-7bcecb951edc service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-115aab16-2815-4bee-8da1-bfbaf3ccb0c0 req-3c60f595-1bec-464f-9286-7bcecb951edc service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] No waiting events found dispatching network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:03:35 user nova-compute[72520]: WARNING nova.compute.manager [req-115aab16-2815-4bee-8da1-bfbaf3ccb0c0 req-3c60f595-1bec-464f-9286-7bcecb951edc service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received unexpected event network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef for instance with vm_state active and task_state None.
Aug 03 00:03:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing instance network info cache due to event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updated VIF entry in instance network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:03:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3bf4e5bc-0ffc-4f71-927f-2797a845f209 req-5d804786-0b9a-42b0-ac9a-2df970b88dff service nova] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:03:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:58 user nova-compute[72520]: INFO nova.compute.manager [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Shelving
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-637e622f-c973-4925-93ab-52364ae18867 req-2d4720ed-b238-415f-8415-196e2e4e1162 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-637e622f-c973-4925-93ab-52364ae18867 req-2d4720ed-b238-415f-8415-196e2e4e1162 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-637e622f-c973-4925-93ab-52364ae18867 req-2d4720ed-b238-415f-8415-196e2e4e1162 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-637e622f-c973-4925-93ab-52364ae18867 req-2d4720ed-b238-415f-8415-196e2e4e1162 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-637e622f-c973-4925-93ab-52364ae18867 req-2d4720ed-b238-415f-8415-196e2e4e1162 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:03:58 user nova-compute[72520]: WARNING nova.compute.manager [req-637e622f-c973-4925-93ab-52364ae18867 req-2d4720ed-b238-415f-8415-196e2e4e1162 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state active and task_state shelving.
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance destroyed successfully.
Aug 03 00:03:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Beginning cold snapshot process
Aug 03 00:03:59 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk /opt/stack/data/nova/instances/snapshots/tmp_sg733ld/c43a80f3945c4cb4ab8eb29658fffd19 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk /opt/stack/data/nova/instances/snapshots/tmp_sg733ld/c43a80f3945c4cb4ab8eb29658fffd19" returned: 0 in 0.601s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:03:59 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Snapshot extracted, beginning image upload
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:03:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:04:00 user nova-compute[72520]: WARNING nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:04:00 user nova-compute[72520]: WARNING nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:04:00 user nova-compute[72520]: WARNING nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:04:00 user nova-compute[72520]: WARNING nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:04:00 user nova-compute[72520]: WARNING nova.compute.manager [req-5810a0a2-2e7a-46c5-86ba-5a973732c271 req-983579c3-7b7c-45d1-97bf-87dae7c443f8 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 00:04:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:01 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Snapshot image upload complete
Aug 03 00:04:01 user nova-compute[72520]: DEBUG nova.compute.manager [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:04:01 user nova-compute[72520]: INFO nova.compute.manager [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Shelve offloading
Aug 03 00:04:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance destroyed successfully.
Aug 03 00:04:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:04:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:04:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:04:02 user nova-compute[72520]: DEBUG nova.network.neutron [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:04:02 user nova-compute[72520]: DEBUG nova.network.neutron [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:04:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:04:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance destroyed successfully.
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.objects.instance [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'resources' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-813989366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-813989366',id=39,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOmR/vYtBy+44PEK18LBiLVP4SfwyCoBYyzF9CCAe5biZLu7Q3tKyTmIJfQ54qDGG7YF6UdJ9vbqEj27iRDYkhnBvsl6AeJq6+yUR213VX5p35b96ZnDK+sXpBuFiZSLw==',key_name='tempest-keypair-396377392',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:02:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-av5s58ey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member',shelved_at='2023-08-03T00:04:01.924145',shelved_host='user',shelved_image_id='95e99739-6246-4ec0-b3b0-f4351c1712e9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=f3a7f181-b3b8-4688-a50a-3ecd6911a731,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG os_vif [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing instance network info cache due to event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.network.neutron [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap307b5527-bb, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:03 user nova-compute[72520]: INFO os_vif [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb')
Aug 03 00:04:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Deleting instance files /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731_del
Aug 03 00:04:03 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Deletion of /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731_del complete
Aug 03 00:04:03 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Deleted allocations for instance f3a7f181-b3b8-4688-a50a-3ecd6911a731
Aug 03 00:04:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.objects.instance [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'numa_topology' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.network.neutron [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updated VIF entry in instance network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG nova.network.neutron [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap307b5527-bb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ddea0aae-18a3-473f-a277-343249b872b6 req-76028004-f15c-449f-b437-c8936d12e072 service nova] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:04:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-afd986ad-87ac-43dd-8d9e-64b528839813 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.794s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:04:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [{"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:04:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-525c1354-331d-4075-95af-df3dae596dba" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:04:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:04:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:04:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:04:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8480MB free_disk=25.253353118896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 525c1354-331d-4075-95af-df3dae596dba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 2954a414-3633-4279-a326-092e1eef2256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:04:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:04:13 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021038.8254864, f3a7f181-b3b8-4688-a50a-3ecd6911a731 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:04:13 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] VM Stopped (Lifecycle Event)
Aug 03 00:04:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9ae95050-7bf8-45a4-81aa-488368c90385 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:04:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:04:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:04:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:04:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:38 user nova-compute[72520]: INFO nova.compute.manager [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Terminating instance
Aug 03 00:04:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-adf164e6-76ac-4bc1-9496-aa5091b1a3fe req-14566c3c-590b-4a6b-85ce-69b7b27b57bc service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-adf164e6-76ac-4bc1-9496-aa5091b1a3fe req-14566c3c-590b-4a6b-85ce-69b7b27b57bc service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-adf164e6-76ac-4bc1-9496-aa5091b1a3fe req-14566c3c-590b-4a6b-85ce-69b7b27b57bc service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-adf164e6-76ac-4bc1-9496-aa5091b1a3fe req-14566c3c-590b-4a6b-85ce-69b7b27b57bc service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-adf164e6-76ac-4bc1-9496-aa5091b1a3fe req-14566c3c-590b-4a6b-85ce-69b7b27b57bc service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:04:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-adf164e6-76ac-4bc1-9496-aa5091b1a3fe req-14566c3c-590b-4a6b-85ce-69b7b27b57bc service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-unplugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Instance destroyed successfully.
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lazy-loading 'resources' on Instance uuid 525c1354-331d-4075-95af-df3dae596dba {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1996012707',display_name='tempest-ServerActionsTestOtherB-server-1996012707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1996012707',id=35,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRkWVTFcC7UA96L3wrjZcgqs3IQKGKhoYmuVcMr7gxgVxmx4dPKBOEzQWKSkJWWk/VpJi9fnVvXNkcEpRXsPgE2tTE1lh1MgsFru4gCuuYJDwJawNsUvfL1D3JKJFSy5w==',key_name='tempest-keypair-5522553',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:02:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d2bc015de264348a271db0a4e6a3615',ramdisk_id='',reservation_id='r-qs5zm0cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1849233865',owner_user_name='tempest-ServerActionsTestOtherB-1849233865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7575219fc35f44bd9e10cea1089f18c4',uuid=525c1354-331d-4075-95af-df3dae596dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converting VIF {"id": "fd871833-3bb6-4119-b904-e27a4440e86b", "address": "fa:16:3e:06:61:f1", "network": {"id": "1ff6b724-4c1b-48f6-9101-7f6bce512cf5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1100094194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d2bc015de264348a271db0a4e6a3615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd871833-3b", "ovs_interfaceid": "fd871833-3bb6-4119-b904-e27a4440e86b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_vif [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd871833-3b, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:39 user nova-compute[72520]: INFO os_vif [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:61:f1,bridge_name='br-int',has_traffic_filtering=True,id=fd871833-3bb6-4119-b904-e27a4440e86b,network=Network(1ff6b724-4c1b-48f6-9101-7f6bce512cf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd871833-3b')
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUlaGWbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:04:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e513f-a707-4dbf-a55b-a07fd9611f11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f38d4a-bd8d-4aff-8774-038d1d1557c8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:04:39 user nova-compute[72520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:04:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 (non-flash)
Aug 03 00:04:39 user nova-compute[72520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:04:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4275cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[632b1429-db61-4f85-9f3c-f275856897c4]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccaa2a3-ccbf-4f9f-a8fc-2489e7fe746c]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd39177-2870-4d95-9d87-9f31f0385e7d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[924677ef-578a-4af0-9409-5280fca76106]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab8c678-4c50-4b3c-a556-f622f3e65bda]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f2b104-f199-4a47-bc0f-963648218c41]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260]
Aug 03 00:04:39 user nova-compute[72520]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3, portal: 172.16.0.220,3260] successful.
Aug 03 00:04:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f07ff6-87a1-4e4c-959b-dc2166b860f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5955b7d8-0d7f-4dc1-be41-988285ac8cba]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] <== disconnect_volume: return (246ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:04:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Deleting instance files /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba_del
Aug 03 00:04:39 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Deletion of /opt/stack/data/nova/instances/525c1354-331d-4075-95af-df3dae596dba_del complete
Aug 03 00:04:39 user nova-compute[72520]: INFO nova.compute.manager [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 03 00:04:39 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:04:39 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:04:40 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:04:40 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] Took 0.90 seconds to deallocate network for instance.
Aug 03 00:04:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-2e2dfd9e-87d8-461e-a6ff-92c94d9d1094 req-21f41f12-da5c-4750-8074-daee36afb2c9 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-deleted-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:40 user nova-compute[72520]: INFO nova.compute.manager [req-2e2dfd9e-87d8-461e-a6ff-92c94d9d1094 req-21f41f12-da5c-4750-8074-daee36afb2c9 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Neutron deleted interface fd871833-3bb6-4119-b904-e27a4440e86b; detaching it from the instance and deleting it from the info cache
Aug 03 00:04:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-2e2dfd9e-87d8-461e-a6ff-92c94d9d1094 req-21f41f12-da5c-4750-8074-daee36afb2c9 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:04:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-2e2dfd9e-87d8-461e-a6ff-92c94d9d1094 req-21f41f12-da5c-4750-8074-daee36afb2c9 service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Detach interface failed, port_id=fd871833-3bb6-4119-b904-e27a4440e86b, reason: Instance 525c1354-331d-4075-95af-df3dae596dba could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:04:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-4d884116-2961-46b8-8fdd-1c33e6b20faf req-8718a241-357b-4632-83ad-acaab683436f service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:04:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4d884116-2961-46b8-8fdd-1c33e6b20faf req-8718a241-357b-4632-83ad-acaab683436f service nova] Acquiring lock "525c1354-331d-4075-95af-df3dae596dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4d884116-2961-46b8-8fdd-1c33e6b20faf req-8718a241-357b-4632-83ad-acaab683436f service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4d884116-2961-46b8-8fdd-1c33e6b20faf req-8718a241-357b-4632-83ad-acaab683436f service nova] Lock "525c1354-331d-4075-95af-df3dae596dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-4d884116-2961-46b8-8fdd-1c33e6b20faf req-8718a241-357b-4632-83ad-acaab683436f service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] No waiting events found dispatching network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:04:40 user nova-compute[72520]: WARNING nova.compute.manager [req-4d884116-2961-46b8-8fdd-1c33e6b20faf req-8718a241-357b-4632-83ad-acaab683436f service nova] [instance: 525c1354-331d-4075-95af-df3dae596dba] Received unexpected event network-vif-plugged-fd871833-3bb6-4119-b904-e27a4440e86b for instance with vm_state active and task_state deleting.
Aug 03 00:04:41 user nova-compute[72520]: INFO nova.compute.manager [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] [instance: 525c1354-331d-4075-95af-df3dae596dba] Took 0.71 seconds to detach 1 volumes for instance.
Aug 03 00:04:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:04:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:04:41 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:04:41 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:04:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:41 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Deleted allocations for instance 525c1354-331d-4075-95af-df3dae596dba
Aug 03 00:04:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c2561773-5ea6-46d2-baca-7b8f132abf59 tempest-ServerActionsTestOtherB-1849233865 tempest-ServerActionsTestOtherB-1849233865-project-member] Lock "525c1354-331d-4075-95af-df3dae596dba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.102s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:04:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:04:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:04:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:04:54 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021079.3623946, 525c1354-331d-4075-95af-df3dae596dba => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:04:54 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 525c1354-331d-4075-95af-df3dae596dba] VM Stopped (Lifecycle Event)
Aug 03 00:04:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-3cc7f776-3cc2-4dde-8f3f-2fe4894563a5 None None] [instance: 525c1354-331d-4075-95af-df3dae596dba] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:04:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:04:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:05:01 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquired lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:01 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:05:01 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'info_cache' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Releasing lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance destroyed successfully.
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'resources' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG os_vif [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap571c58f6-40, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:05:02 user nova-compute[72520]: INFO os_vif [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40')
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Start _get_guest_xml network_info=[{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:02 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:02 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:05:02 user nova-compute[72520]:   <uuid>0ada24d4-91f7-4d2f-bd25-6c226d313331</uuid>
Aug 03 00:05:02 user nova-compute[72520]:   <name>instance-00000025</name>
Aug 03 00:05:02 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:05:02 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:05:02 user nova-compute[72520]:   <metadata>
Aug 03 00:05:02 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:05:02 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:05:02 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeTestJSON-server-548410330</nova:name>
Aug 03 00:05:02 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:05:02</nova:creationTime>
Aug 03 00:05:02 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:05:02 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:05:02 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:05:02 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:05:02 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:05:02 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:05:02 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:05:02 user nova-compute[72520]:       <nova:owner>
Aug 03 00:05:02 user nova-compute[72520]:         <nova:user uuid="7ce27b8383604c46ab82b2af76c7e26b">tempest-AttachVolumeTestJSON-2114655012-project-member</nova:user>
Aug 03 00:05:02 user nova-compute[72520]:         <nova:project uuid="e4088b685db6408fa8b3231fa95405e7">tempest-AttachVolumeTestJSON-2114655012</nova:project>
Aug 03 00:05:02 user nova-compute[72520]:       </nova:owner>
Aug 03 00:05:02 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:05:02 user nova-compute[72520]:       <nova:ports>
Aug 03 00:05:02 user nova-compute[72520]:         <nova:port uuid="571c58f6-401f-4632-916d-646803b6f25f">
Aug 03 00:05:02 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 03 00:05:02 user nova-compute[72520]:         </nova:port>
Aug 03 00:05:02 user nova-compute[72520]:       </nova:ports>
Aug 03 00:05:02 user nova-compute[72520]:     </nova:instance>
Aug 03 00:05:02 user nova-compute[72520]:   </metadata>
Aug 03 00:05:02 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:05:02 user nova-compute[72520]:     <system>
Aug 03 00:05:02 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:05:02 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:05:02 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:05:02 user nova-compute[72520]:       <entry name="serial">0ada24d4-91f7-4d2f-bd25-6c226d313331</entry>
Aug 03 00:05:02 user nova-compute[72520]:       <entry name="uuid">0ada24d4-91f7-4d2f-bd25-6c226d313331</entry>
Aug 03 00:05:02 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:05:02 user nova-compute[72520]:     </system>
Aug 03 00:05:02 user nova-compute[72520]:   </sysinfo>
Aug 03 00:05:02 user nova-compute[72520]:   <os>
Aug 03 00:05:02 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:05:02 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:05:02 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:05:02 user nova-compute[72520]:   </os>
Aug 03 00:05:02 user nova-compute[72520]:   <features>
Aug 03 00:05:02 user nova-compute[72520]:     <acpi/>
Aug 03 00:05:02 user nova-compute[72520]:     <apic/>
Aug 03 00:05:02 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:05:02 user nova-compute[72520]:   </features>
Aug 03 00:05:02 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:05:02 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:05:02 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:05:02 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:05:02 user nova-compute[72520]:   </clock>
Aug 03 00:05:02 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:05:02 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:05:02 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:05:02 user nova-compute[72520]:   </cpu>
Aug 03 00:05:02 user nova-compute[72520]:   <devices>
Aug 03 00:05:02 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:05:02 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:05:02 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk"/>
Aug 03 00:05:02 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:05:02 user nova-compute[72520]:     </disk>
Aug 03 00:05:02 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:05:02 user nova-compute[72520]:       <mac address="fa:16:3e:8a:9e:16"/>
Aug 03 00:05:02 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:02 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:05:02 user nova-compute[72520]:       <target dev="tap571c58f6-40"/>
Aug 03 00:05:02 user nova-compute[72520]:     </interface>
Aug 03 00:05:02 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:05:02 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/console.log" append="off"/>
Aug 03 00:05:02 user nova-compute[72520]:     </serial>
Aug 03 00:05:02 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:05:02 user nova-compute[72520]:     <video>
Aug 03 00:05:02 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:02 user nova-compute[72520]:     </video>
Aug 03 00:05:02 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:05:02 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:05:02 user nova-compute[72520]:     </rng>
Aug 03 00:05:02 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:05:02 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:05:02 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:05:02 user nova-compute[72520]:     </memballoon>
Aug 03 00:05:02 user nova-compute[72520]:   </devices>
Aug 03 00:05:02 user nova-compute[72520]: </domain>
Aug 03 00:05:02 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Cannot resize image /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'migration_context' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG os_vif [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap571c58f6-40, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap571c58f6-40, col_values=(('external_ids', {'iface-id': '571c58f6-401f-4632-916d-646803b6f25f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:9e:16', 'vm-uuid': '0ada24d4-91f7-4d2f-bd25-6c226d313331'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:05:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:03 user nova-compute[72520]: INFO os_vif [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40')
Aug 03 00:05:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-d1b440ea-106e-48db-b838-2c61595f2304 req-362aaea5-3b44-4303-9540-02aa08880d99 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d1b440ea-106e-48db-b838-2c61595f2304 req-362aaea5-3b44-4303-9540-02aa08880d99 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d1b440ea-106e-48db-b838-2c61595f2304 req-362aaea5-3b44-4303-9540-02aa08880d99 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d1b440ea-106e-48db-b838-2c61595f2304 req-362aaea5-3b44-4303-9540-02aa08880d99 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:04 user nova-compute[72520]: DEBUG nova.compute.manager [req-d1b440ea-106e-48db-b838-2c61595f2304 req-362aaea5-3b44-4303-9540-02aa08880d99 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:05:04 user nova-compute[72520]: WARNING nova.compute.manager [req-d1b440ea-106e-48db-b838-2c61595f2304 req-362aaea5-3b44-4303-9540-02aa08880d99 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state stopped and task_state powering-on.
Aug 03 00:05:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021106.7735534, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:05:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Resumed (Lifecycle Event)
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:05:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance rebooted successfully.
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d51e5f42-d976-4a3d-9e28-97c5517e68f6 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:05:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021106.7790625, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:05:06 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Started (Lifecycle Event)
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846f09e-e121-4e5c-b855-c65aa61e3d16 req-c22413d5-c982-477a-a6db-f028c7fc66b3 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846f09e-e121-4e5c-b855-c65aa61e3d16 req-c22413d5-c982-477a-a6db-f028c7fc66b3 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846f09e-e121-4e5c-b855-c65aa61e3d16 req-c22413d5-c982-477a-a6db-f028c7fc66b3 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-4846f09e-e121-4e5c-b855-c65aa61e3d16 req-c22413d5-c982-477a-a6db-f028c7fc66b3 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-4846f09e-e121-4e5c-b855-c65aa61e3d16 req-c22413d5-c982-477a-a6db-f028c7fc66b3 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:05:06 user nova-compute[72520]: WARNING nova.compute.manager [req-4846f09e-e121-4e5c-b855-c65aa61e3d16 req-c22413d5-c982-477a-a6db-f028c7fc66b3 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state active and task_state None.
Aug 03 00:05:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:10 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:05:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:05:10 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [{"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0ada24d4-91f7-4d2f-bd25-6c226d313331" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:05:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=25.28002166748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 2954a414-3633-4279-a326-092e1eef2256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:05:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-changed-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Refreshing instance network info cache due to event network-changed-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] Acquiring lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] Acquired lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Refreshing network info cache for port 7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updated VIF entry in instance network info cache for port 7efb6cb9-bc2d-4af7-8a96-9cc91f279cef. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updating instance_info_cache with network_info: [{"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bdfc691a-2d16-4d5e-bf30-51e3729d4f4f req-5d970608-b6cb-4d6d-8089-d57eb4f651cf service nova] Releasing lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:05:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:05:23 user nova-compute[72520]: INFO nova.compute.claims [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Claim successful on node user
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:05:23 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:05:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:05:23 user nova-compute[72520]: INFO nova.virt.block_device [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Booting with volume snapshot dd40c2ac-2cad-45e3-8d18-f484cc225e20 at /dev/vda
Aug 03 00:05:23 user nova-compute[72520]: DEBUG nova.policy [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f4f73d9df5413590eb77ae2b94090d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a710f41a5a44408a041238b388d588e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:05:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:05:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Successfully created port: 31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Successfully updated port: 31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquired lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-changed-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.compute.manager [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Refreshing instance network info cache due to event network-changed-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] Acquiring lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updating instance_info_cache with network_info: [{"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Releasing lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Instance network_info: |[{"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] Acquired lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:25 user nova-compute[72520]: DEBUG nova.network.neutron [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Refreshing network info cache for port 31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:05:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updated VIF entry in instance network info cache for port 31a861ac-06af-46ae-a2e2-c5b9f98c9c3a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:05:26 user nova-compute[72520]: DEBUG nova.network.neutron [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updating instance_info_cache with network_info: [{"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7249e4d9-3a73-43d3-ba58-b931e92a0b56 req-99bba69f-abe1-4d9e-acf0-fcc40e089d45 service nova] Releasing lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG os_brick.utils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82ca24-b0cc-4977-b4a2-a8a2d0428ff4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[946cc10d-08e4-4a60-8770-70b0ab82b871]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a864e36e-23f8-4d4d-a3a0-ed23b0577b1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce780777-9b90-4464-ab71-855f5824a007]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:05:29 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:05:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1d0591-62eb-4c71-9a01-11a8ca93f9c4]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG os_brick.utils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updating existing volume attachment record: 76a81cd4-91c7-4997-b03f-082eefaf9f08 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:05:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:05:36 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Creating image(s)
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Ensure instance console log exists: /opt/stack/data/nova/instances/9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Start _get_guest_xml network_info=[{"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-03T00:05:16Z,direct_url=<?>,disk_format='qcow2',id=c478f522-08ea-41cd-b7d1-05da5f79e734,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-415154897',owner='4a710f41a5a44408a041238b388d588e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-03T00:05:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDQvqNnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c', 'attached_at': '', 'detached_at': '', 'volume_id': 'de7e34c6-63a2-4550-a9c8-8631afe307a8', 'serial': 'de7e34c6-63a2-4550-a9c8-8631afe307a8'}, 'attachment_id': '76a81cd4-91c7-4997-b03f-082eefaf9f08', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:05:36 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:36 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-03T00:05:16Z,direct_url=<?>,disk_format='qcow2',id=c478f522-08ea-41cd-b7d1-05da5f79e734,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-415154897',owner='4a710f41a5a44408a041238b388d588e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-03T00:05:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDQvqNnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:05:36 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:05:36 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:05:36 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[39706e46-b8fb-4de6-bfec-489f372cc1d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:05:36 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412e627-31ca-4b4a-bdd8-4fa675324bc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8] added
Aug 03 00:05:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[749da42f-47ca-4749-b172-d006681e1b91]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34db899-8f37-4f1f-85d0-d2b5a826a740]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDQvqNnS {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDQvqNnS" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06538fe8-2ad1-4edc-830e-31e849210a9a]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDQvqNnS'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d27f5e-003e-489d-b9e2-deec3b4f0b34]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31feb531-131b-4fb4-91aa-f647de2b308c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:05:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:05:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b246d6-5437-41ab-8470-8c445bf2e094]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260]
Aug 03 00:05:36 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260] successful.
Aug 03 00:05:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2ddba5-4e12-438d-8282-5c03d8281b76]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0158637-9778-41e0-b3e1-d5de7ccb4f7f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:05:36 user nova-compute[72520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 (non-flash)
Aug 03 00:05:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:05:36 user nova-compute[72520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 (non-flash)
Aug 03 00:05:36 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a654eab-ad63-4e4f-a90b-8996f7a18262]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:05:36 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDQvqNnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23530633065366432', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530633065366432', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1421095825',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1421095825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1421095825',id=41,image_ref='c478f522-08ea-41cd-b7d1-05da5f79e734',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaVdgXqKUDF4UrWAOwXrOf3xX9p5dcWhWBpZcSSJnvaLY7DfI4Lkx5yz5mBd9hjTQX8OBfZYkXNJ9RGMNcjuHtwZdeI/wAiDbp83v79BTB21QQ2suUhXGoVQA1vp85saQ==',key_name='tempest-keypair-1685524849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-bg2cosdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1675749395',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a1:ba,bridge_name='br-int',has_traffic_filtering=True,id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a861ac-06') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:05:38 user nova-compute[72520]:   <uuid>9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c</uuid>
Aug 03 00:05:38 user nova-compute[72520]:   <name>instance-00000029</name>
Aug 03 00:05:38 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:05:38 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:05:38 user nova-compute[72520]:   <metadata>
Aug 03 00:05:38 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:05:38 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:05:38 user nova-compute[72520]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1421095825</nova:name>
Aug 03 00:05:38 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:05:36</nova:creationTime>
Aug 03 00:05:38 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:05:38 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:05:38 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:05:38 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:05:38 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:05:38 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:05:38 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:05:38 user nova-compute[72520]:       <nova:owner>
Aug 03 00:05:38 user nova-compute[72520]:         <nova:user uuid="53f4f73d9df5413590eb77ae2b94090d">tempest-TestVolumeBootPattern-1675749395-project-member</nova:user>
Aug 03 00:05:38 user nova-compute[72520]:         <nova:project uuid="4a710f41a5a44408a041238b388d588e">tempest-TestVolumeBootPattern-1675749395</nova:project>
Aug 03 00:05:38 user nova-compute[72520]:       </nova:owner>
Aug 03 00:05:38 user nova-compute[72520]:       <nova:root type="image" uuid="c478f522-08ea-41cd-b7d1-05da5f79e734"/>
Aug 03 00:05:38 user nova-compute[72520]:       <nova:ports>
Aug 03 00:05:38 user nova-compute[72520]:         <nova:port uuid="31a861ac-06af-46ae-a2e2-c5b9f98c9c3a">
Aug 03 00:05:38 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 00:05:38 user nova-compute[72520]:         </nova:port>
Aug 03 00:05:38 user nova-compute[72520]:       </nova:ports>
Aug 03 00:05:38 user nova-compute[72520]:     </nova:instance>
Aug 03 00:05:38 user nova-compute[72520]:   </metadata>
Aug 03 00:05:38 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:05:38 user nova-compute[72520]:     <system>
Aug 03 00:05:38 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:05:38 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:05:38 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:05:38 user nova-compute[72520]:       <entry name="serial">9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c</entry>
Aug 03 00:05:38 user nova-compute[72520]:       <entry name="uuid">9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c</entry>
Aug 03 00:05:38 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:05:38 user nova-compute[72520]:     </system>
Aug 03 00:05:38 user nova-compute[72520]:   </sysinfo>
Aug 03 00:05:38 user nova-compute[72520]:   <os>
Aug 03 00:05:38 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:05:38 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:05:38 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:05:38 user nova-compute[72520]:   </os>
Aug 03 00:05:38 user nova-compute[72520]:   <features>
Aug 03 00:05:38 user nova-compute[72520]:     <acpi/>
Aug 03 00:05:38 user nova-compute[72520]:     <apic/>
Aug 03 00:05:38 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:05:38 user nova-compute[72520]:   </features>
Aug 03 00:05:38 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:05:38 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:05:38 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:05:38 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:05:38 user nova-compute[72520]:   </clock>
Aug 03 00:05:38 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:05:38 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:05:38 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:05:38 user nova-compute[72520]:   </cpu>
Aug 03 00:05:38 user nova-compute[72520]:   <devices>
Aug 03 00:05:38 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:05:38 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:05:38 user nova-compute[72520]:       <source dev="/dev/sdc"/>
Aug 03 00:05:38 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:05:38 user nova-compute[72520]:       <serial>de7e34c6-63a2-4550-a9c8-8631afe307a8</serial>
Aug 03 00:05:38 user nova-compute[72520]:     </disk>
Aug 03 00:05:38 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:05:38 user nova-compute[72520]:       <mac address="fa:16:3e:bd:a1:ba"/>
Aug 03 00:05:38 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:38 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:05:38 user nova-compute[72520]:       <target dev="tap31a861ac-06"/>
Aug 03 00:05:38 user nova-compute[72520]:     </interface>
Aug 03 00:05:38 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:05:38 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c/console.log" append="off"/>
Aug 03 00:05:38 user nova-compute[72520]:     </serial>
Aug 03 00:05:38 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:05:38 user nova-compute[72520]:     <video>
Aug 03 00:05:38 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:38 user nova-compute[72520]:     </video>
Aug 03 00:05:38 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:05:38 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:05:38 user nova-compute[72520]:     </rng>
Aug 03 00:05:38 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:05:38 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:05:38 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:05:38 user nova-compute[72520]:     </memballoon>
Aug 03 00:05:38 user nova-compute[72520]:   </devices>
Aug 03 00:05:38 user nova-compute[72520]: </domain>
Aug 03 00:05:38 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1421095825',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1421095825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1421095825',id=41,image_ref='c478f522-08ea-41cd-b7d1-05da5f79e734',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaVdgXqKUDF4UrWAOwXrOf3xX9p5dcWhWBpZcSSJnvaLY7DfI4Lkx5yz5mBd9hjTQX8OBfZYkXNJ9RGMNcjuHtwZdeI/wAiDbp83v79BTB21QQ2suUhXGoVQA1vp85saQ==',key_name='tempest-keypair-1685524849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-bg2cosdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1675749395',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a1:ba,bridge_name='br-int',has_traffic_filtering=True,id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a861ac-06') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG os_vif [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a1:ba,bridge_name='br-int',has_traffic_filtering=True,id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a861ac-06') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31a861ac-06, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31a861ac-06, col_values=(('external_ids', {'iface-id': '31a861ac-06af-46ae-a2e2-c5b9f98c9c3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:a1:ba', 'vm-uuid': '9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:38 user nova-compute[72520]: INFO os_vif [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a1:ba,bridge_name='br-int',has_traffic_filtering=True,id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a861ac-06')
Aug 03 00:05:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:05:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No VIF found with MAC fa:16:3e:bd:a1:ba, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-03d8c910-d472-4636-a696-4afa1f9da0b0 req-3f89ca9e-f54e-4a5c-87e6-f08cb7d2aa2a service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-03d8c910-d472-4636-a696-4afa1f9da0b0 req-3f89ca9e-f54e-4a5c-87e6-f08cb7d2aa2a service nova] Acquiring lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-03d8c910-d472-4636-a696-4afa1f9da0b0 req-3f89ca9e-f54e-4a5c-87e6-f08cb7d2aa2a service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-03d8c910-d472-4636-a696-4afa1f9da0b0 req-3f89ca9e-f54e-4a5c-87e6-f08cb7d2aa2a service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-03d8c910-d472-4636-a696-4afa1f9da0b0 req-3f89ca9e-f54e-4a5c-87e6-f08cb7d2aa2a service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] No waiting events found dispatching network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:05:39 user nova-compute[72520]: WARNING nova.compute.manager [req-03d8c910-d472-4636-a696-4afa1f9da0b0 req-3f89ca9e-f54e-4a5c-87e6-f08cb7d2aa2a service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received unexpected event network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a for instance with vm_state building and task_state spawning.
Aug 03 00:05:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021141.444264, 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:05:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] VM Resumed (Lifecycle Event)
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:05:41 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Instance spawned successfully.
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:05:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021141.4454, 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:05:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] VM Started (Lifecycle Event)
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:05:41 user nova-compute[72520]: INFO nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:41 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-cd389fce-de7b-49a9-89d8-f3692815c44d req-15d51e18-a7e1-40c1-9ac5-16f90d8d0c2f service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cd389fce-de7b-49a9-89d8-f3692815c44d req-15d51e18-a7e1-40c1-9ac5-16f90d8d0c2f service nova] Acquiring lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cd389fce-de7b-49a9-89d8-f3692815c44d req-15d51e18-a7e1-40c1-9ac5-16f90d8d0c2f service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-cd389fce-de7b-49a9-89d8-f3692815c44d req-15d51e18-a7e1-40c1-9ac5-16f90d8d0c2f service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-cd389fce-de7b-49a9-89d8-f3692815c44d req-15d51e18-a7e1-40c1-9ac5-16f90d8d0c2f service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] No waiting events found dispatching network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:05:41 user nova-compute[72520]: WARNING nova.compute.manager [req-cd389fce-de7b-49a9-89d8-f3692815c44d req-15d51e18-a7e1-40c1-9ac5-16f90d8d0c2f service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received unexpected event network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a for instance with vm_state building and task_state spawning.
Aug 03 00:05:41 user nova-compute[72520]: INFO nova.compute.manager [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Took 18.65 seconds to build instance.
Aug 03 00:05:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b35d884-fa5a-4751-96a1-6480086473de tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.751s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:05:46 user nova-compute[72520]: INFO nova.compute.claims [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Claim successful on node user
Aug 03 00:05:46 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:05:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.policy [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6361183670f8430ab54cdbcd5f40f8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b23638b890649bebd9d3be398b9451d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:05:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Creating image(s)
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "/opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "/opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "/opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk 1073741824" returned: 0 in 0.052s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Successfully created port: 80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Cannot resize image /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.objects.instance [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lazy-loading 'migration_context' on Instance uuid a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Ensure instance console log exists: /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Successfully updated port: 80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquired lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.compute.manager [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received event network-changed-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.compute.manager [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Refreshing instance network info cache due to event network-changed-80c7398a-532a-4d1a-97c4-e5188e69722b. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] Acquiring lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Releasing lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Instance network_info: |[{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] Acquired lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.neutron [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Refreshing network info cache for port 80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Start _get_guest_xml network_info=[{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:05:48 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:48 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1106919353',display_name='tempest-ServersNegativeTestJSON-server-1106919353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1106919353',id=42,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b23638b890649bebd9d3be398b9451d',ramdisk_id='',reservation_id='r-sx1lifqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-80248803',owner_user_name='tempest-ServersNegativeTestJSON-80248803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:05:47Z,user_data=None,user_id='6361183670f8430ab54cdbcd5f40f8de',uuid=a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converting VIF {"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e7:50,bridge_name='br-int',has_traffic_filtering=True,id=80c7398a-532a-4d1a-97c4-e5188e69722b,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c7398a-53') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.objects.instance [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lazy-loading 'pci_devices' on Instance uuid a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:05:48 user nova-compute[72520]:   <uuid>a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20</uuid>
Aug 03 00:05:48 user nova-compute[72520]:   <name>instance-0000002a</name>
Aug 03 00:05:48 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:05:48 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:05:48 user nova-compute[72520]:   <metadata>
Aug 03 00:05:48 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:05:48 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:05:48 user nova-compute[72520]:       <nova:name>tempest-ServersNegativeTestJSON-server-1106919353</nova:name>
Aug 03 00:05:48 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:05:48</nova:creationTime>
Aug 03 00:05:48 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:05:48 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:05:48 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:05:48 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:05:48 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:05:48 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:05:48 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:05:48 user nova-compute[72520]:       <nova:owner>
Aug 03 00:05:48 user nova-compute[72520]:         <nova:user uuid="6361183670f8430ab54cdbcd5f40f8de">tempest-ServersNegativeTestJSON-80248803-project-member</nova:user>
Aug 03 00:05:48 user nova-compute[72520]:         <nova:project uuid="4b23638b890649bebd9d3be398b9451d">tempest-ServersNegativeTestJSON-80248803</nova:project>
Aug 03 00:05:48 user nova-compute[72520]:       </nova:owner>
Aug 03 00:05:48 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:05:48 user nova-compute[72520]:       <nova:ports>
Aug 03 00:05:48 user nova-compute[72520]:         <nova:port uuid="80c7398a-532a-4d1a-97c4-e5188e69722b">
Aug 03 00:05:48 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 00:05:48 user nova-compute[72520]:         </nova:port>
Aug 03 00:05:48 user nova-compute[72520]:       </nova:ports>
Aug 03 00:05:48 user nova-compute[72520]:     </nova:instance>
Aug 03 00:05:48 user nova-compute[72520]:   </metadata>
Aug 03 00:05:48 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:05:48 user nova-compute[72520]:     <system>
Aug 03 00:05:48 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:05:48 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:05:48 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:05:48 user nova-compute[72520]:       <entry name="serial">a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20</entry>
Aug 03 00:05:48 user nova-compute[72520]:       <entry name="uuid">a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20</entry>
Aug 03 00:05:48 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:05:48 user nova-compute[72520]:     </system>
Aug 03 00:05:48 user nova-compute[72520]:   </sysinfo>
Aug 03 00:05:48 user nova-compute[72520]:   <os>
Aug 03 00:05:48 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:05:48 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:05:48 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:05:48 user nova-compute[72520]:   </os>
Aug 03 00:05:48 user nova-compute[72520]:   <features>
Aug 03 00:05:48 user nova-compute[72520]:     <acpi/>
Aug 03 00:05:48 user nova-compute[72520]:     <apic/>
Aug 03 00:05:48 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:05:48 user nova-compute[72520]:   </features>
Aug 03 00:05:48 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:05:48 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:05:48 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:05:48 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:05:48 user nova-compute[72520]:   </clock>
Aug 03 00:05:48 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:05:48 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:05:48 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:05:48 user nova-compute[72520]:   </cpu>
Aug 03 00:05:48 user nova-compute[72520]:   <devices>
Aug 03 00:05:48 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:05:48 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:05:48 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk"/>
Aug 03 00:05:48 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:05:48 user nova-compute[72520]:     </disk>
Aug 03 00:05:48 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:05:48 user nova-compute[72520]:       <mac address="fa:16:3e:9b:e7:50"/>
Aug 03 00:05:48 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:48 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:05:48 user nova-compute[72520]:       <target dev="tap80c7398a-53"/>
Aug 03 00:05:48 user nova-compute[72520]:     </interface>
Aug 03 00:05:48 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:05:48 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/console.log" append="off"/>
Aug 03 00:05:48 user nova-compute[72520]:     </serial>
Aug 03 00:05:48 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:05:48 user nova-compute[72520]:     <video>
Aug 03 00:05:48 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:48 user nova-compute[72520]:     </video>
Aug 03 00:05:48 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:05:48 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:05:48 user nova-compute[72520]:     </rng>
Aug 03 00:05:48 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:05:48 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:05:48 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:05:48 user nova-compute[72520]:     </memballoon>
Aug 03 00:05:48 user nova-compute[72520]:   </devices>
Aug 03 00:05:48 user nova-compute[72520]: </domain>
Aug 03 00:05:48 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1106919353',display_name='tempest-ServersNegativeTestJSON-server-1106919353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1106919353',id=42,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b23638b890649bebd9d3be398b9451d',ramdisk_id='',reservation_id='r-sx1lifqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-80248803',owner_user_name='tempest-ServersNegativeTestJSON-80248803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:05:47Z,user_data=None,user_id='6361183670f8430ab54cdbcd5f40f8de',uuid=a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converting VIF {"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e7:50,bridge_name='br-int',has_traffic_filtering=True,id=80c7398a-532a-4d1a-97c4-e5188e69722b,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c7398a-53') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG os_vif [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e7:50,bridge_name='br-int',has_traffic_filtering=True,id=80c7398a-532a-4d1a-97c4-e5188e69722b,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c7398a-53') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80c7398a-53, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80c7398a-53, col_values=(('external_ids', {'iface-id': '80c7398a-532a-4d1a-97c4-e5188e69722b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:e7:50', 'vm-uuid': 'a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:05:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:48 user nova-compute[72520]: INFO os_vif [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:e7:50,bridge_name='br-int',has_traffic_filtering=True,id=80c7398a-532a-4d1a-97c4-e5188e69722b,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c7398a-53')
Aug 03 00:05:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:05:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] No VIF found with MAC fa:16:3e:9b:e7:50, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:05:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:49 user nova-compute[72520]: DEBUG nova.network.neutron [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updated VIF entry in instance network info cache for port 80c7398a-532a-4d1a-97c4-e5188e69722b. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:05:49 user nova-compute[72520]: DEBUG nova.network.neutron [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c377eaa8-e606-4803-909a-7996240cb9e4 req-d83295d5-1c4d-470f-96cb-8fe6a5593ab4 service nova] Releasing lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-d21707f7-5f47-469e-bd4e-2e7059fd6398 req-49e54c05-0dec-4685-84da-dc8a63ff52ff service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received event network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d21707f7-5f47-469e-bd4e-2e7059fd6398 req-49e54c05-0dec-4685-84da-dc8a63ff52ff service nova] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d21707f7-5f47-469e-bd4e-2e7059fd6398 req-49e54c05-0dec-4685-84da-dc8a63ff52ff service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d21707f7-5f47-469e-bd4e-2e7059fd6398 req-49e54c05-0dec-4685-84da-dc8a63ff52ff service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-d21707f7-5f47-469e-bd4e-2e7059fd6398 req-49e54c05-0dec-4685-84da-dc8a63ff52ff service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] No waiting events found dispatching network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:05:50 user nova-compute[72520]: WARNING nova.compute.manager [req-d21707f7-5f47-469e-bd4e-2e7059fd6398 req-49e54c05-0dec-4685-84da-dc8a63ff52ff service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received unexpected event network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b for instance with vm_state building and task_state spawning.
Aug 03 00:05:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:51 user nova-compute[72520]: INFO nova.compute.manager [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Unshelving
Aug 03 00:05:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'pci_requests' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'numa_topology' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:05:51 user nova-compute[72520]: INFO nova.compute.claims [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Claim successful on node user
Aug 03 00:05:51 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:05:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:51 user nova-compute[72520]: INFO nova.network.neutron [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating port 307b5527-bbe8-434e-874c-7eca23941f5e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021152.5107098, a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:05:52 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] VM Resumed (Lifecycle Event)
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:05:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Instance spawned successfully.
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:05:52 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021152.515428, a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:05:52 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] VM Started (Lifecycle Event)
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:05:52 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:05:52 user nova-compute[72520]: INFO nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.network.neutron [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:05:52 user nova-compute[72520]: INFO nova.compute.manager [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Took 6.02 seconds to build instance.
Aug 03 00:05:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-719f6390-75ee-4c9d-8010-4012be6a9ee2 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.107s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received event network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] No waiting events found dispatching network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:05:52 user nova-compute[72520]: WARNING nova.compute.manager [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received unexpected event network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b for instance with vm_state active and task_state None.
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing instance network info cache due to event network-changed-307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:05:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:05:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Creating image(s)
Aug 03 00:05:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Refreshing network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "86519c4413a1b25851bc4aace7c0a558df8b8c0f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "86519c4413a1b25851bc4aace7c0a558df8b8c0f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.part --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.part --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG nova.virt.images [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] 95e99739-6246-4ec0-b3b0-f4351c1712e9 was qcow2, converting to raw {{(pid=72520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG nova.privsep.utils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.part /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.converted {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updated VIF entry in instance network info cache for port 307b5527-bbe8-434e-874c-7eca23941f5e. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c2f3efd3-3c3e-4677-a8df-f36d66f6da2c req-f6df9a1d-4ca9-4192-a8cc-d25de8852d57 service nova] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.part /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.converted" returned: 0 in 0.510s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:54 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.converted --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "86519c4413a1b25851bc4aace7c0a558df8b8c0f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.928s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "86519c4413a1b25851bc4aace7c0a558df8b8c0f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "86519c4413a1b25851bc4aace7c0a558df8b8c0f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f,backing_fmt=raw /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f,backing_fmt=raw /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk 1073741824" returned: 0 in 0.050s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "86519c4413a1b25851bc4aace7c0a558df8b8c0f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'migration_context' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:55 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Rebasing disk image.
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:55 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab -F raw /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab -F raw /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk" returned: 0 in 2.497s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Ensure instance console log exists: /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Start _get_guest_xml network_info=[{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1a36e5de240a777097b69bc9ec9c2901',container_format='bare',created_at=2023-08-03T00:03:58Z,direct_url=<?>,disk_format='qcow2',id=95e99739-6246-4ec0-b3b0-f4351c1712e9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-813989366-shelved',owner='a16f380acff84d95b2bfb049709f4246',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-03T00:04:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:05:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:58 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1a36e5de240a777097b69bc9ec9c2901',container_format='bare',created_at=2023-08-03T00:03:58Z,direct_url=<?>,disk_format='qcow2',id=95e99739-6246-4ec0-b3b0-f4351c1712e9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-813989366-shelved',owner='a16f380acff84d95b2bfb049709f4246',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-03T00:04:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T00:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-813989366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-813989366',id=39,image_ref='95e99739-6246-4ec0-b3b0-f4351c1712e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-396377392',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:02:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-av5s58ey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member',shelved_at='2023-08-03T00:04:01.924145',shelved_host='user',shelved_image_id='95e99739-6246-4ec0-b3b0-f4351c1712e9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=f3a7f181-b3b8-4688-a50a-3ecd6911a731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'pci_devices' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:05:58 user nova-compute[72520]:   <uuid>f3a7f181-b3b8-4688-a50a-3ecd6911a731</uuid>
Aug 03 00:05:58 user nova-compute[72520]:   <name>instance-00000027</name>
Aug 03 00:05:58 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:05:58 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:05:58 user nova-compute[72520]:   <metadata>
Aug 03 00:05:58 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:05:58 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:05:58 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-813989366</nova:name>
Aug 03 00:05:58 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:05:58</nova:creationTime>
Aug 03 00:05:58 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:05:58 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:05:58 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:05:58 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:05:58 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:05:58 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:05:58 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:05:58 user nova-compute[72520]:       <nova:owner>
Aug 03 00:05:58 user nova-compute[72520]:         <nova:user uuid="4f9ec64c4b24430e8f7ee755a9f37806">tempest-AttachVolumeShelveTestJSON-952018091-project-member</nova:user>
Aug 03 00:05:58 user nova-compute[72520]:         <nova:project uuid="a16f380acff84d95b2bfb049709f4246">tempest-AttachVolumeShelveTestJSON-952018091</nova:project>
Aug 03 00:05:58 user nova-compute[72520]:       </nova:owner>
Aug 03 00:05:58 user nova-compute[72520]:       <nova:root type="image" uuid="95e99739-6246-4ec0-b3b0-f4351c1712e9"/>
Aug 03 00:05:58 user nova-compute[72520]:       <nova:ports>
Aug 03 00:05:58 user nova-compute[72520]:         <nova:port uuid="307b5527-bbe8-434e-874c-7eca23941f5e">
Aug 03 00:05:58 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 03 00:05:58 user nova-compute[72520]:         </nova:port>
Aug 03 00:05:58 user nova-compute[72520]:       </nova:ports>
Aug 03 00:05:58 user nova-compute[72520]:     </nova:instance>
Aug 03 00:05:58 user nova-compute[72520]:   </metadata>
Aug 03 00:05:58 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:05:58 user nova-compute[72520]:     <system>
Aug 03 00:05:58 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:05:58 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:05:58 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:05:58 user nova-compute[72520]:       <entry name="serial">f3a7f181-b3b8-4688-a50a-3ecd6911a731</entry>
Aug 03 00:05:58 user nova-compute[72520]:       <entry name="uuid">f3a7f181-b3b8-4688-a50a-3ecd6911a731</entry>
Aug 03 00:05:58 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:05:58 user nova-compute[72520]:     </system>
Aug 03 00:05:58 user nova-compute[72520]:   </sysinfo>
Aug 03 00:05:58 user nova-compute[72520]:   <os>
Aug 03 00:05:58 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:05:58 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:05:58 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:05:58 user nova-compute[72520]:   </os>
Aug 03 00:05:58 user nova-compute[72520]:   <features>
Aug 03 00:05:58 user nova-compute[72520]:     <acpi/>
Aug 03 00:05:58 user nova-compute[72520]:     <apic/>
Aug 03 00:05:58 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:05:58 user nova-compute[72520]:   </features>
Aug 03 00:05:58 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:05:58 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:05:58 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:05:58 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:05:58 user nova-compute[72520]:   </clock>
Aug 03 00:05:58 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:05:58 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:05:58 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:05:58 user nova-compute[72520]:   </cpu>
Aug 03 00:05:58 user nova-compute[72520]:   <devices>
Aug 03 00:05:58 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:05:58 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:05:58 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk"/>
Aug 03 00:05:58 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:05:58 user nova-compute[72520]:     </disk>
Aug 03 00:05:58 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:05:58 user nova-compute[72520]:       <mac address="fa:16:3e:41:cf:06"/>
Aug 03 00:05:58 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:58 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:05:58 user nova-compute[72520]:       <target dev="tap307b5527-bb"/>
Aug 03 00:05:58 user nova-compute[72520]:     </interface>
Aug 03 00:05:58 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:05:58 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/console.log" append="off"/>
Aug 03 00:05:58 user nova-compute[72520]:     </serial>
Aug 03 00:05:58 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:05:58 user nova-compute[72520]:     <video>
Aug 03 00:05:58 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:05:58 user nova-compute[72520]:     </video>
Aug 03 00:05:58 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:05:58 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:05:58 user nova-compute[72520]:     </rng>
Aug 03 00:05:58 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:05:58 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:05:58 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:05:58 user nova-compute[72520]:     </memballoon>
Aug 03 00:05:58 user nova-compute[72520]:   </devices>
Aug 03 00:05:58 user nova-compute[72520]: </domain>
Aug 03 00:05:58 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T00:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-813989366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-813989366',id=39,image_ref='95e99739-6246-4ec0-b3b0-f4351c1712e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-396377392',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:02:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-av5s58ey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member',shelved_at='2023-08-03T00:04:01.924145',shelved_host='user',shelved_image_id='95e99739-6246-4ec0-b3b0-f4351c1712e9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=f3a7f181-b3b8-4688-a50a-3ecd6911a731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG os_vif [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap307b5527-bb, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap307b5527-bb, col_values=(('external_ids', {'iface-id': '307b5527-bbe8-434e-874c-7eca23941f5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:cf:06', 'vm-uuid': 'f3a7f181-b3b8-4688-a50a-3ecd6911a731'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:05:58 user nova-compute[72520]: INFO os_vif [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb')
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:05:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] No VIF found with MAC fa:16:3e:41:cf:06, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:05:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-029e3e55-e35e-4605-8020-04194e35740b req-bf85f134-ce04-4fe0-9abe-2ef54a8afe61 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-029e3e55-e35e-4605-8020-04194e35740b req-bf85f134-ce04-4fe0-9abe-2ef54a8afe61 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-029e3e55-e35e-4605-8020-04194e35740b req-bf85f134-ce04-4fe0-9abe-2ef54a8afe61 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-029e3e55-e35e-4605-8020-04194e35740b req-bf85f134-ce04-4fe0-9abe-2ef54a8afe61 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-029e3e55-e35e-4605-8020-04194e35740b req-bf85f134-ce04-4fe0-9abe-2ef54a8afe61 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:06:00 user nova-compute[72520]: WARNING nova.compute.manager [req-029e3e55-e35e-4605-8020-04194e35740b req-bf85f134-ce04-4fe0-9abe-2ef54a8afe61 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 03 00:06:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021162.2708614, f3a7f181-b3b8-4688-a50a-3ecd6911a731 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:06:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] VM Resumed (Lifecycle Event)
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:06:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance spawned successfully.
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-7dbad7cc-4fc5-4b86-8454-2b90d45a115b req-03fa363d-dab6-468c-91e2-fc514bb54e28 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7dbad7cc-4fc5-4b86-8454-2b90d45a115b req-03fa363d-dab6-468c-91e2-fc514bb54e28 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7dbad7cc-4fc5-4b86-8454-2b90d45a115b req-03fa363d-dab6-468c-91e2-fc514bb54e28 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7dbad7cc-4fc5-4b86-8454-2b90d45a115b req-03fa363d-dab6-468c-91e2-fc514bb54e28 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-7dbad7cc-4fc5-4b86-8454-2b90d45a115b req-03fa363d-dab6-468c-91e2-fc514bb54e28 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:06:02 user nova-compute[72520]: WARNING nova.compute.manager [req-7dbad7cc-4fc5-4b86-8454-2b90d45a115b req-03fa363d-dab6-468c-91e2-fc514bb54e28 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 03 00:06:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021162.2723753, f3a7f181-b3b8-4688-a50a-3ecd6911a731 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:06:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] VM Started (Lifecycle Event)
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:06:02 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:06:02 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:06:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1a2bc2f2-f7bd-479a-8bfb-7fa09d0d5f9c tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.313s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:06:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:06:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:06:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:06:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updating instance_info_cache with network_info: [{"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-2954a414-3633-4279-a326-092e1eef2256" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:06:13 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:14 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:06:14 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:06:14 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8162MB free_disk=25.224075317382812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 2954a414-3633-4279-a326-092e1eef2256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f3a7f181-b3b8-4688-a50a-3ecd6911a731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:06:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:06:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Verify base images {{(pid=72520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Image id bf7ff550-99bb-492f-8b9b-e7b427d12188 yields fingerprint 6249d67cc86a3a000c7773ff7eabaedf3366a3ab {{(pid=72520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] image bf7ff550-99bb-492f-8b9b-e7b427d12188 at (/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab): checking
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] image bf7ff550-99bb-492f-8b9b-e7b427d12188 at (/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab): image is in use {{(pid=72520) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Image id c478f522-08ea-41cd-b7d1-05da5f79e734 yields fingerprint 73a5f8eb932edb2934f38971aebbe5768803799f {{(pid=72520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] 0ada24d4-91f7-4d2f-bd25-6c226d313331 is a valid instance name {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] 0ada24d4-91f7-4d2f-bd25-6c226d313331 has a disk file {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0ada24d4-91f7-4d2f-bd25-6c226d313331 is backed by 6249d67cc86a3a000c7773ff7eabaedf3366a3ab {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 is a valid instance name {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 has a disk file {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 is backed by 6249d67cc86a3a000c7773ff7eabaedf3366a3ab {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] 2954a414-3633-4279-a326-092e1eef2256 is a valid instance name {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c is a valid instance name {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] f3a7f181-b3b8-4688-a50a-3ecd6911a731 is a valid instance name {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] f3a7f181-b3b8-4688-a50a-3ecd6911a731 has a disk file {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f3a7f181-b3b8-4688-a50a-3ecd6911a731 is backed by 6249d67cc86a3a000c7773ff7eabaedf3366a3ab {{(pid=72520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07
Aug 03 00:06:37 user nova-compute[72520]: WARNING nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Active base files: /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Removable base files: /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5 /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3 /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879 /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07 /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b80c5d62e69a54a135785c00893c3e21a809ea6a
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cfa3795d2eb41a681d566391869dc900a4639be5
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/62abcb74171a0242d2d759e35e2bb468644b5a7d
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a4328ddb0fd53ae7a8aa1d049c9e9be5f7e27ae3
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ab364876d6313528cfcaa8c770ed547deafb44b
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f875e026f32a1a050e7279a9ec4b68d067486879
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/86519c4413a1b25851bc4aace7c0a558df8b8c0f
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1d005ef2821317fca23a05c2f5e4304bd2696b07
Aug 03 00:06:37 user nova-compute[72520]: INFO nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c9dafebb7f01e1ae10d21f0e16b9692effc00392
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Verification complete {{(pid=72520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Verify swap images {{(pid=72520) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 03 00:06:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.imagecache [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Verify ephemeral images {{(pid=72520) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 03 00:06:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:06:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:06:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:06:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:06:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:06:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:06:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:06:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:06:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:06:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:53 user nova-compute[72520]: INFO nova.compute.manager [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Terminating instance
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-ce6480f1-09c0-404d-9a1c-28ee835f0626 req-8fd8564a-6211-4882-827f-dfe39c0107e8 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ce6480f1-09c0-404d-9a1c-28ee835f0626 req-8fd8564a-6211-4882-827f-dfe39c0107e8 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ce6480f1-09c0-404d-9a1c-28ee835f0626 req-8fd8564a-6211-4882-827f-dfe39c0107e8 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ce6480f1-09c0-404d-9a1c-28ee835f0626 req-8fd8564a-6211-4882-827f-dfe39c0107e8 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-ce6480f1-09c0-404d-9a1c-28ee835f0626 req-8fd8564a-6211-4882-827f-dfe39c0107e8 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-ce6480f1-09c0-404d-9a1c-28ee835f0626 req-8fd8564a-6211-4882-827f-dfe39c0107e8 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-unplugged-571c58f6-401f-4632-916d-646803b6f25f for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Instance destroyed successfully.
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'resources' on Instance uuid 0ada24d4-91f7-4d2f-bd25-6c226d313331 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-02T23:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-548410330',display_name='tempest-AttachVolumeTestJSON-server-548410330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-548410330',id=37,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsS9HXIRUaXwChs+emJajwGiedKR8ZstAdFiWBIpSxbacRJgTBR49ko7mNYDJP1wLzjomY8yEeFXoAN2xLj9KNIhAVb0qJC7OtRPdcJSa8SMbnr3h6I6TuJQdYBc7MSUQ==',key_name='tempest-keypair-1186190097',keypairs=<?>,launch_index=0,launched_at=2023-08-02T23:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-dxhdj5l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=0ada24d4-91f7-4d2f-bd25-6c226d313331,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "571c58f6-401f-4632-916d-646803b6f25f", "address": "fa:16:3e:8a:9e:16", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571c58f6-40", "ovs_interfaceid": "571c58f6-401f-4632-916d-646803b6f25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG os_vif [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap571c58f6-40, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:06:53 user nova-compute[72520]: INFO os_vif [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=571c58f6-401f-4632-916d-646803b6f25f,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571c58f6-40')
Aug 03 00:06:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Deleting instance files /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331_del
Aug 03 00:06:54 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Deletion of /opt/stack/data/nova/instances/0ada24d4-91f7-4d2f-bd25-6c226d313331_del complete
Aug 03 00:06:54 user nova-compute[72520]: INFO nova.compute.manager [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 03 00:06:54 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:06:54 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:06:54 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:06:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:06:54 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:06:55 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Took 0.93 seconds to deallocate network for instance.
Aug 03 00:06:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-51df6193-727b-4a32-a604-8f6d25492e72 req-e46611c5-ebfe-4acc-a15c-bafa534edc71 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-deleted-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:55 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Deleted allocations for instance 0ada24d4-91f7-4d2f-bd25-6c226d313331
Aug 03 00:06:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2ca3aab9-7162-4f84-9990-5000f12087e2 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.387s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-d8a571e5-32eb-40f6-8cdc-42870d5e5dc9 req-339c0a0e-2d3d-414f-8016-f5e6123e6502 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8a571e5-32eb-40f6-8cdc-42870d5e5dc9 req-339c0a0e-2d3d-414f-8016-f5e6123e6502 service nova] Acquiring lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8a571e5-32eb-40f6-8cdc-42870d5e5dc9 req-339c0a0e-2d3d-414f-8016-f5e6123e6502 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8a571e5-32eb-40f6-8cdc-42870d5e5dc9 req-339c0a0e-2d3d-414f-8016-f5e6123e6502 service nova] Lock "0ada24d4-91f7-4d2f-bd25-6c226d313331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:06:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-d8a571e5-32eb-40f6-8cdc-42870d5e5dc9 req-339c0a0e-2d3d-414f-8016-f5e6123e6502 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] No waiting events found dispatching network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:06:55 user nova-compute[72520]: WARNING nova.compute.manager [req-d8a571e5-32eb-40f6-8cdc-42870d5e5dc9 req-339c0a0e-2d3d-414f-8016-f5e6123e6502 service nova] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Received unexpected event network-vif-plugged-571c58f6-401f-4632-916d-646803b6f25f for instance with vm_state deleted and task_state None.
Aug 03 00:06:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:08 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021213.9407094, 0ada24d4-91f7-4d2f-bd25-6c226d313331 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:07:08 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] VM Stopped (Lifecycle Event)
Aug 03 00:07:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-a6671b9b-2dad-432d-bf83-a1d934c69f69 None None] [instance: 0ada24d4-91f7-4d2f-bd25-6c226d313331] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:07:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:07:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:07:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:09 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 00:07:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [{"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-f3a7f181-b3b8-4688-a50a-3ecd6911a731" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:07:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:07:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-changed-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Refreshing instance network info cache due to event network-changed-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] Acquiring lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] Acquired lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Refreshing network info cache for port 31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updated VIF entry in instance network info cache for port 31a861ac-06af-46ae-a2e2-c5b9f98c9c3a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updating instance_info_cache with network_info: [{"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:14 user nova-compute[72520]: INFO nova.compute.manager [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Terminating instance
Aug 03 00:07:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-56d5043f-d299-4bf8-a75a-084bb76a902e req-4544eee1-cab5-4561-93e7-6aee44605140 service nova] Releasing lock "refresh_cache-9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-e1c74328-8863-42de-b860-0cabf9a30024 req-76f1e5ad-f3c4-4339-9833-3cc4c0ced569 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-vif-unplugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e1c74328-8863-42de-b860-0cabf9a30024 req-76f1e5ad-f3c4-4339-9833-3cc4c0ced569 service nova] Acquiring lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e1c74328-8863-42de-b860-0cabf9a30024 req-76f1e5ad-f3c4-4339-9833-3cc4c0ced569 service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e1c74328-8863-42de-b860-0cabf9a30024 req-76f1e5ad-f3c4-4339-9833-3cc4c0ced569 service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-e1c74328-8863-42de-b860-0cabf9a30024 req-76f1e5ad-f3c4-4339-9833-3cc4c0ced569 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] No waiting events found dispatching network-vif-unplugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-e1c74328-8863-42de-b860-0cabf9a30024 req-76f1e5ad-f3c4-4339-9833-3cc4c0ced569 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-vif-unplugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:07:15 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Instance destroyed successfully.
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'resources' on Instance uuid 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1421095825',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1421095825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1421095825',id=41,image_ref='c478f522-08ea-41cd-b7d1-05da5f79e734',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaVdgXqKUDF4UrWAOwXrOf3xX9p5dcWhWBpZcSSJnvaLY7DfI4Lkx5yz5mBd9hjTQX8OBfZYkXNJ9RGMNcjuHtwZdeI/wAiDbp83v79BTB21QQ2suUhXGoVQA1vp85saQ==',key_name='tempest-keypair-1685524849',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-bg2cosdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1675749395',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "address": "fa:16:3e:bd:a1:ba", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a861ac-06", "ovs_interfaceid": "31a861ac-06af-46ae-a2e2-c5b9f98c9c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a1:ba,bridge_name='br-int',has_traffic_filtering=True,id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a861ac-06') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_vif [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a1:ba,bridge_name='br-int',has_traffic_filtering=True,id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a861ac-06') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31a861ac-06, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:15 user nova-compute[72520]: INFO os_vif [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:a1:ba,bridge_name='br-int',has_traffic_filtering=True,id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a861ac-06')
Aug 03 00:07:15 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:07:15 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8292MB free_disk=25.241649627685547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDQvqNnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:07:15 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3edb51-360f-4125-bb27-52c231d11fee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e336d56b-f6be-45a3-a1d7-b8e2d0e700a4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:07:15 user nova-compute[72520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 (non-flash)
Aug 03 00:07:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:07:15 user nova-compute[72520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 (non-flash)
Aug 03 00:07:15 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce460e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:07:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25b619d-de60-4427-9c9d-814b3891b7e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 2954a414-3633-4279-a326-092e1eef2256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance f3a7f181-b3b8-4688-a50a-3ecd6911a731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1892f8b-355d-4e99-9c24-5b490e34f212]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e5085d-8b54-4824-b1d4-f1df623faf06]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4cf84b-9c74-4734-9e64-9e67cbcb96d2]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d5bf7-0074-431a-b59c-7d0593bd4bc5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4082389d-493d-4ba7-b49d-ef243d7c0fc3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260]
Aug 03 00:07:16 user nova-compute[72520]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8, portal: 172.16.0.220,3260] successful.
Aug 03 00:07:16 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7e34c6-63a2-4550-a9c8-8631afe307a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[154f3df9-6fb6-41a5-a98e-728928944480]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== disconnect_volume: return (279ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:07:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Deleting instance files /opt/stack/data/nova/instances/9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c_del
Aug 03 00:07:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Deletion of /opt/stack/data/nova/instances/9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c_del complete
Aug 03 00:07:16 user nova-compute[72520]: INFO nova.compute.manager [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Took 1.54 seconds to destroy the instance on the hypervisor.
Aug 03 00:07:16 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:07:16 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:16 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Took 0.70 seconds to deallocate network for instance.
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a9a20f1-e8ad-4b37-92aa-6b03dd4a3a45 req-86d6aa55-23d6-4d41-9f06-c2517780a7a7 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-vif-deleted-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:17 user nova-compute[72520]: INFO nova.compute.manager [req-1a9a20f1-e8ad-4b37-92aa-6b03dd4a3a45 req-86d6aa55-23d6-4d41-9f06-c2517780a7a7 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Neutron deleted interface 31a861ac-06af-46ae-a2e2-c5b9f98c9c3a; detaching it from the instance and deleting it from the info cache
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.network.neutron [req-1a9a20f1-e8ad-4b37-92aa-6b03dd4a3a45 req-86d6aa55-23d6-4d41-9f06-c2517780a7a7 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a9a20f1-e8ad-4b37-92aa-6b03dd4a3a45 req-86d6aa55-23d6-4d41-9f06-c2517780a7a7 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Detach interface failed, port_id=31a861ac-06af-46ae-a2e2-c5b9f98c9c3a, reason: Instance 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-d428010b-7c68-490b-bdca-e5fe1206b65c req-25516f60-4bb3-4087-9352-ff0fe4dc56f0 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received event network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d428010b-7c68-490b-bdca-e5fe1206b65c req-25516f60-4bb3-4087-9352-ff0fe4dc56f0 service nova] Acquiring lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d428010b-7c68-490b-bdca-e5fe1206b65c req-25516f60-4bb3-4087-9352-ff0fe4dc56f0 service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d428010b-7c68-490b-bdca-e5fe1206b65c req-25516f60-4bb3-4087-9352-ff0fe4dc56f0 service nova] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.manager [req-d428010b-7c68-490b-bdca-e5fe1206b65c req-25516f60-4bb3-4087-9352-ff0fe4dc56f0 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] No waiting events found dispatching network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:17 user nova-compute[72520]: WARNING nova.compute.manager [req-d428010b-7c68-490b-bdca-e5fe1206b65c req-25516f60-4bb3-4087-9352-ff0fe4dc56f0 service nova] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Received unexpected event network-vif-plugged-31a861ac-06af-46ae-a2e2-c5b9f98c9c3a for instance with vm_state active and task_state deleting.
Aug 03 00:07:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 00:07:17 user nova-compute[72520]: INFO nova.compute.manager [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Took 0.72 seconds to detach 1 volumes for instance.
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Deleting volume: de7e34c6-63a2-4550-a9c8-8631afe307a8 {{(pid=72520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:07:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:07:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:18 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Deleted allocations for instance 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c
Aug 03 00:07:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2314a545-5039-497e-a7d7-d1c7be5c7d2e tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.379s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:30 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021235.475339, 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:07:30 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] VM Stopped (Lifecycle Event)
Aug 03 00:07:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1ca2e821-908e-4040-a610-9e239d362ffd None None] [instance: 9f988d1b-8bd2-4e3d-94d2-fcacfe4ff96c] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:07:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:37 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:07:37 user nova-compute[72520]: INFO nova.compute.claims [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Claim successful on node user
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.network.neutron [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:07:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.policy [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6361183670f8430ab54cdbcd5f40f8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b23638b890649bebd9d3be398b9451d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:07:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Creating image(s)
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "/opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "/opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.147s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk 1073741824" returned: 0 in 0.051s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:07:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Successfully created port: df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Cannot resize image /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lazy-loading 'migration_context' on Instance uuid 9e5e2748-c774-4e5b-a5be-96972d7120b9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Ensure instance console log exists: /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Successfully updated port: df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "refresh_cache-9e5e2748-c774-4e5b-a5be-96972d7120b9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquired lock "refresh_cache-9e5e2748-c774-4e5b-a5be-96972d7120b9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received event network-changed-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.compute.manager [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Refreshing instance network info cache due to event network-changed-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] Acquiring lock "refresh_cache-9e5e2748-c774-4e5b-a5be-96972d7120b9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:07:39 user nova-compute[72520]: DEBUG nova.network.neutron [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.neutron [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Updating instance_info_cache with network_info: [{"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Releasing lock "refresh_cache-9e5e2748-c774-4e5b-a5be-96972d7120b9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Instance network_info: |[{"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] Acquired lock "refresh_cache-9e5e2748-c774-4e5b-a5be-96972d7120b9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Refreshing network info cache for port df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Start _get_guest_xml network_info=[{"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:07:40 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:07:40 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1248791340',display_name='tempest-ServersNegativeTestJSON-server-1248791340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1248791340',id=43,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b23638b890649bebd9d3be398b9451d',ramdisk_id='',reservation_id='r-9pm67cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-80248803',owner_user_name='tempest-ServersNegativeTestJSON-80248803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:07:38Z,user_data=None,user_id='6361183670f8430ab54cdbcd5f40f8de',uuid=9e5e2748-c774-4e5b-a5be-96972d7120b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converting VIF {"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:25,bridge_name='br-int',has_traffic_filtering=True,id=df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9e7d7e-ed') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.objects.instance [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e5e2748-c774-4e5b-a5be-96972d7120b9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:07:40 user nova-compute[72520]:   <uuid>9e5e2748-c774-4e5b-a5be-96972d7120b9</uuid>
Aug 03 00:07:40 user nova-compute[72520]:   <name>instance-0000002b</name>
Aug 03 00:07:40 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:07:40 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:07:40 user nova-compute[72520]:   <metadata>
Aug 03 00:07:40 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:07:40 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:07:40 user nova-compute[72520]:       <nova:name>tempest-ServersNegativeTestJSON-server-1248791340</nova:name>
Aug 03 00:07:40 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:07:40</nova:creationTime>
Aug 03 00:07:40 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:07:40 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:07:40 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:07:40 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:07:40 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:07:40 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:07:40 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:07:40 user nova-compute[72520]:       <nova:owner>
Aug 03 00:07:40 user nova-compute[72520]:         <nova:user uuid="6361183670f8430ab54cdbcd5f40f8de">tempest-ServersNegativeTestJSON-80248803-project-member</nova:user>
Aug 03 00:07:40 user nova-compute[72520]:         <nova:project uuid="4b23638b890649bebd9d3be398b9451d">tempest-ServersNegativeTestJSON-80248803</nova:project>
Aug 03 00:07:40 user nova-compute[72520]:       </nova:owner>
Aug 03 00:07:40 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:07:40 user nova-compute[72520]:       <nova:ports>
Aug 03 00:07:40 user nova-compute[72520]:         <nova:port uuid="df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46">
Aug 03 00:07:40 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 00:07:40 user nova-compute[72520]:         </nova:port>
Aug 03 00:07:40 user nova-compute[72520]:       </nova:ports>
Aug 03 00:07:40 user nova-compute[72520]:     </nova:instance>
Aug 03 00:07:40 user nova-compute[72520]:   </metadata>
Aug 03 00:07:40 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:07:40 user nova-compute[72520]:     <system>
Aug 03 00:07:40 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:07:40 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:07:40 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:07:40 user nova-compute[72520]:       <entry name="serial">9e5e2748-c774-4e5b-a5be-96972d7120b9</entry>
Aug 03 00:07:40 user nova-compute[72520]:       <entry name="uuid">9e5e2748-c774-4e5b-a5be-96972d7120b9</entry>
Aug 03 00:07:40 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:07:40 user nova-compute[72520]:     </system>
Aug 03 00:07:40 user nova-compute[72520]:   </sysinfo>
Aug 03 00:07:40 user nova-compute[72520]:   <os>
Aug 03 00:07:40 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:07:40 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:07:40 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:07:40 user nova-compute[72520]:   </os>
Aug 03 00:07:40 user nova-compute[72520]:   <features>
Aug 03 00:07:40 user nova-compute[72520]:     <acpi/>
Aug 03 00:07:40 user nova-compute[72520]:     <apic/>
Aug 03 00:07:40 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:07:40 user nova-compute[72520]:   </features>
Aug 03 00:07:40 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:07:40 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:07:40 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:07:40 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:07:40 user nova-compute[72520]:   </clock>
Aug 03 00:07:40 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:07:40 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:07:40 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:07:40 user nova-compute[72520]:   </cpu>
Aug 03 00:07:40 user nova-compute[72520]:   <devices>
Aug 03 00:07:40 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:07:40 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:07:40 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk"/>
Aug 03 00:07:40 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:07:40 user nova-compute[72520]:     </disk>
Aug 03 00:07:40 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:07:40 user nova-compute[72520]:       <mac address="fa:16:3e:85:78:25"/>
Aug 03 00:07:40 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:07:40 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:07:40 user nova-compute[72520]:       <target dev="tapdf9e7d7e-ed"/>
Aug 03 00:07:40 user nova-compute[72520]:     </interface>
Aug 03 00:07:40 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:07:40 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/console.log" append="off"/>
Aug 03 00:07:40 user nova-compute[72520]:     </serial>
Aug 03 00:07:40 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:07:40 user nova-compute[72520]:     <video>
Aug 03 00:07:40 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:07:40 user nova-compute[72520]:     </video>
Aug 03 00:07:40 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:07:40 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:07:40 user nova-compute[72520]:     </rng>
Aug 03 00:07:40 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:07:40 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:07:40 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:07:40 user nova-compute[72520]:     </memballoon>
Aug 03 00:07:40 user nova-compute[72520]:   </devices>
Aug 03 00:07:40 user nova-compute[72520]: </domain>
Aug 03 00:07:40 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1248791340',display_name='tempest-ServersNegativeTestJSON-server-1248791340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1248791340',id=43,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b23638b890649bebd9d3be398b9451d',ramdisk_id='',reservation_id='r-9pm67cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-80248803',owner_user_name='tempest-ServersNegativeTestJSON-80248803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:07:38Z,user_data=None,user_id='6361183670f8430ab54cdbcd5f40f8de',uuid=9e5e2748-c774-4e5b-a5be-96972d7120b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converting VIF {"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:25,bridge_name='br-int',has_traffic_filtering=True,id=df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9e7d7e-ed') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG os_vif [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:25,bridge_name='br-int',has_traffic_filtering=True,id=df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9e7d7e-ed') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf9e7d7e-ed, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf9e7d7e-ed, col_values=(('external_ids', {'iface-id': 'df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:78:25', 'vm-uuid': '9e5e2748-c774-4e5b-a5be-96972d7120b9'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:40 user nova-compute[72520]: INFO os_vif [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:25,bridge_name='br-int',has_traffic_filtering=True,id=df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9e7d7e-ed')
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] No VIF found with MAC fa:16:3e:85:78:25, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Updated VIF entry in instance network info cache for port df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG nova.network.neutron [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Updating instance_info_cache with network_info: [{"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-81013206-d7c2-47bf-ba93-9d6228b44002 req-22af544a-15e6-41e2-99c5-f58b30402e6e service nova] Releasing lock "refresh_cache-9e5e2748-c774-4e5b-a5be-96972d7120b9" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:41 user nova-compute[72520]: INFO nova.compute.manager [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Terminating instance
Aug 03 00:07:41 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-508ddcb8-49f3-4b2e-a410-9e83a1049fbe req-ec3e8e60-d67d-472c-8cdd-f4d739d59ef8 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received event network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-508ddcb8-49f3-4b2e-a410-9e83a1049fbe req-ec3e8e60-d67d-472c-8cdd-f4d739d59ef8 service nova] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-508ddcb8-49f3-4b2e-a410-9e83a1049fbe req-ec3e8e60-d67d-472c-8cdd-f4d739d59ef8 service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-508ddcb8-49f3-4b2e-a410-9e83a1049fbe req-ec3e8e60-d67d-472c-8cdd-f4d739d59ef8 service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-508ddcb8-49f3-4b2e-a410-9e83a1049fbe req-ec3e8e60-d67d-472c-8cdd-f4d739d59ef8 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] No waiting events found dispatching network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:41 user nova-compute[72520]: WARNING nova.compute.manager [req-508ddcb8-49f3-4b2e-a410-9e83a1049fbe req-ec3e8e60-d67d-472c-8cdd-f4d739d59ef8 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received unexpected event network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 for instance with vm_state building and task_state spawning.
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-a1576504-47e0-45db-a23c-56c85cf47fd3 req-2e5fb0ed-cf56-4a5c-90a4-88cd81af856a service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a1576504-47e0-45db-a23c-56c85cf47fd3 req-2e5fb0ed-cf56-4a5c-90a4-88cd81af856a service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a1576504-47e0-45db-a23c-56c85cf47fd3 req-2e5fb0ed-cf56-4a5c-90a4-88cd81af856a service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a1576504-47e0-45db-a23c-56c85cf47fd3 req-2e5fb0ed-cf56-4a5c-90a4-88cd81af856a service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-a1576504-47e0-45db-a23c-56c85cf47fd3 req-2e5fb0ed-cf56-4a5c-90a4-88cd81af856a service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:41 user nova-compute[72520]: DEBUG nova.compute.manager [req-a1576504-47e0-45db-a23c-56c85cf47fd3 req-2e5fb0ed-cf56-4a5c-90a4-88cd81af856a service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Instance destroyed successfully.
Aug 03 00:07:42 user nova-compute[72520]: DEBUG nova.objects.instance [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lazy-loading 'resources' on Instance uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T00:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-813989366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-813989366',id=39,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOmR/vYtBy+44PEK18LBiLVP4SfwyCoBYyzF9CCAe5biZLu7Q3tKyTmIJfQ54qDGG7YF6UdJ9vbqEj27iRDYkhnBvsl6AeJq6+yUR213VX5p35b96ZnDK+sXpBuFiZSLw==',key_name='tempest-keypair-396377392',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a16f380acff84d95b2bfb049709f4246',ramdisk_id='',reservation_id='r-av5s58ey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952018091',owner_user_name='tempest-AttachVolumeShelveTestJSON-952018091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ec64c4b24430e8f7ee755a9f37806',uuid=f3a7f181-b3b8-4688-a50a-3ecd6911a731,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converting VIF {"id": "307b5527-bbe8-434e-874c-7eca23941f5e", "address": "fa:16:3e:41:cf:06", "network": {"id": "170a213a-8371-4289-98af-46fb00b16921", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226117740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a16f380acff84d95b2bfb049709f4246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307b5527-bb", "ovs_interfaceid": "307b5527-bbe8-434e-874c-7eca23941f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG os_vif [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap307b5527-bb, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: INFO os_vif [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:cf:06,bridge_name='br-int',has_traffic_filtering=True,id=307b5527-bbe8-434e-874c-7eca23941f5e,network=Network(170a213a-8371-4289-98af-46fb00b16921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap307b5527-bb')
Aug 03 00:07:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Deleting instance files /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731_del
Aug 03 00:07:42 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Deletion of /opt/stack/data/nova/instances/f3a7f181-b3b8-4688-a50a-3ecd6911a731_del complete
Aug 03 00:07:42 user nova-compute[72520]: INFO nova.compute.manager [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 03 00:07:42 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:43 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Took 1.35 seconds to deallocate network for instance.
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-3b6e7f73-34d5-4b51-afe0-1405409c3bd0 req-a433b9b5-9c42-4b95-971e-695abe7e1824 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-deleted-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:43 user nova-compute[72520]: INFO nova.compute.manager [req-3b6e7f73-34d5-4b51-afe0-1405409c3bd0 req-a433b9b5-9c42-4b95-971e-695abe7e1824 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Neutron deleted interface 307b5527-bbe8-434e-874c-7eca23941f5e; detaching it from the instance and deleting it from the info cache
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.network.neutron [req-3b6e7f73-34d5-4b51-afe0-1405409c3bd0 req-a433b9b5-9c42-4b95-971e-695abe7e1824 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-3b6e7f73-34d5-4b51-afe0-1405409c3bd0 req-a433b9b5-9c42-4b95-971e-695abe7e1824 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Detach interface failed, port_id=307b5527-bbe8-434e-874c-7eca23941f5e, reason: Instance f3a7f181-b3b8-4688-a50a-3ecd6911a731 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:43 user nova-compute[72520]: WARNING nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid f3a7f181-b3b8-4688-a50a-3ecd6911a731 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 2954a414-3633-4279-a326-092e1eef2256 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 9e5e2748-c774-4e5b-a5be-96972d7120b9 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "2954a414-3633-4279-a326-092e1eef2256" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "2954a414-3633-4279-a326-092e1eef2256" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-29ed3773-5a88-487d-a866-498f0f53e0bf req-61e02560-49a6-409d-8af5-71d912f5c0a9 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received event network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-29ed3773-5a88-487d-a866-498f0f53e0bf req-61e02560-49a6-409d-8af5-71d912f5c0a9 service nova] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-29ed3773-5a88-487d-a866-498f0f53e0bf req-61e02560-49a6-409d-8af5-71d912f5c0a9 service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-29ed3773-5a88-487d-a866-498f0f53e0bf req-61e02560-49a6-409d-8af5-71d912f5c0a9 service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-29ed3773-5a88-487d-a866-498f0f53e0bf req-61e02560-49a6-409d-8af5-71d912f5c0a9 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] No waiting events found dispatching network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:43 user nova-compute[72520]: WARNING nova.compute.manager [req-29ed3773-5a88-487d-a866-498f0f53e0bf req-61e02560-49a6-409d-8af5-71d912f5c0a9 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received unexpected event network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 for instance with vm_state building and task_state spawning.
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:07:43 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:44 user nova-compute[72520]: WARNING nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state deleted and task_state None.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:44 user nova-compute[72520]: WARNING nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state deleted and task_state None.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:44 user nova-compute[72520]: WARNING nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state deleted and task_state None.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:44 user nova-compute[72520]: WARNING nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-unplugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state deleted and task_state None.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Acquiring lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] No waiting events found dispatching network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:44 user nova-compute[72520]: WARNING nova.compute.manager [req-5e9bdc21-56c6-4fa0-9699-0952a63c13fc req-10a74270-f370-4c84-ae9b-d25af4859f64 service nova] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Received unexpected event network-vif-plugged-307b5527-bbe8-434e-874c-7eca23941f5e for instance with vm_state deleted and task_state None.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021264.0204709, 9e5e2748-c774-4e5b-a5be-96972d7120b9 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] VM Resumed (Lifecycle Event)
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Instance spawned successfully.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Deleted allocations for instance f3a7f181-b3b8-4688-a50a-3ecd6911a731
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021264.021861, 9e5e2748-c774-4e5b-a5be-96972d7120b9 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] VM Started (Lifecycle Event)
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60f0e939-542f-4e42-b3ab-a38fdbb88049 tempest-AttachVolumeShelveTestJSON-952018091 tempest-AttachVolumeShelveTestJSON-952018091-project-member] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.675s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.345s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "f3a7f181-b3b8-4688-a50a-3ecd6911a731" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.compute.manager [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Took 6.30 seconds to build instance.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-282a95b9-ae46-4726-bca2-42c7a2e296c3 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.414s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.441s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:44 user nova-compute[72520]: INFO nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:07:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:07:47 user nova-compute[72520]: INFO nova.compute.claims [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Claim successful on node user
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:07:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.policy [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ce27b8383604c46ab82b2af76c7e26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4088b685db6408fa8b3231fa95405e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:07:47 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Creating image(s)
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "/opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "/opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk 1073741824" returned: 0 in 0.050s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:47 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Successfully created port: fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Cannot resize image /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'migration_context' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Ensure instance console log exists: /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:48 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Successfully updated port: fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquired lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-changed-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.compute.manager [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Refreshing instance network info cache due to event network-changed-fbd59173-100b-4fa7-b3cb-6aeafad97145. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] Acquiring lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.neutron [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updating instance_info_cache with network_info: [{"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Releasing lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Instance network_info: |[{"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] Acquired lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.neutron [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Refreshing network info cache for port fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Start _get_guest_xml network_info=[{"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:07:49 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:07:49 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-586457726',display_name='tempest-AttachVolumeTestJSON-server-586457726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-586457726',id=44,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgANd3VY3VOrcQytu5AFMPpnkTK/XiJT/0w/9tHuzvjIpRxDV60gTZztHNQv4/PdyLzZrWyB7iDiQkwmnKzH06A7dShubZ+1HQBLVmNS4C6JjAclOqp2Plz4JI3zkBeiA==',key_name='tempest-keypair-1255385236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-n24s7yhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=3c268d22-407c-4ae5-8b05-e7b7ba6046dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:dd:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbd59173-100b-4fa7-b3cb-6aeafad97145,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd59173-10') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.objects.instance [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:07:49 user nova-compute[72520]:   <uuid>3c268d22-407c-4ae5-8b05-e7b7ba6046dc</uuid>
Aug 03 00:07:49 user nova-compute[72520]:   <name>instance-0000002c</name>
Aug 03 00:07:49 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:07:49 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:07:49 user nova-compute[72520]:   <metadata>
Aug 03 00:07:49 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:07:49 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:07:49 user nova-compute[72520]:       <nova:name>tempest-AttachVolumeTestJSON-server-586457726</nova:name>
Aug 03 00:07:49 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:07:49</nova:creationTime>
Aug 03 00:07:49 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:07:49 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:07:49 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:07:49 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:07:49 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:07:49 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:07:49 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:07:49 user nova-compute[72520]:       <nova:owner>
Aug 03 00:07:49 user nova-compute[72520]:         <nova:user uuid="7ce27b8383604c46ab82b2af76c7e26b">tempest-AttachVolumeTestJSON-2114655012-project-member</nova:user>
Aug 03 00:07:49 user nova-compute[72520]:         <nova:project uuid="e4088b685db6408fa8b3231fa95405e7">tempest-AttachVolumeTestJSON-2114655012</nova:project>
Aug 03 00:07:49 user nova-compute[72520]:       </nova:owner>
Aug 03 00:07:49 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:07:49 user nova-compute[72520]:       <nova:ports>
Aug 03 00:07:49 user nova-compute[72520]:         <nova:port uuid="fbd59173-100b-4fa7-b3cb-6aeafad97145">
Aug 03 00:07:49 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 03 00:07:49 user nova-compute[72520]:         </nova:port>
Aug 03 00:07:49 user nova-compute[72520]:       </nova:ports>
Aug 03 00:07:49 user nova-compute[72520]:     </nova:instance>
Aug 03 00:07:49 user nova-compute[72520]:   </metadata>
Aug 03 00:07:49 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:07:49 user nova-compute[72520]:     <system>
Aug 03 00:07:49 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:07:49 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:07:49 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:07:49 user nova-compute[72520]:       <entry name="serial">3c268d22-407c-4ae5-8b05-e7b7ba6046dc</entry>
Aug 03 00:07:49 user nova-compute[72520]:       <entry name="uuid">3c268d22-407c-4ae5-8b05-e7b7ba6046dc</entry>
Aug 03 00:07:49 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:07:49 user nova-compute[72520]:     </system>
Aug 03 00:07:49 user nova-compute[72520]:   </sysinfo>
Aug 03 00:07:49 user nova-compute[72520]:   <os>
Aug 03 00:07:49 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:07:49 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:07:49 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:07:49 user nova-compute[72520]:   </os>
Aug 03 00:07:49 user nova-compute[72520]:   <features>
Aug 03 00:07:49 user nova-compute[72520]:     <acpi/>
Aug 03 00:07:49 user nova-compute[72520]:     <apic/>
Aug 03 00:07:49 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:07:49 user nova-compute[72520]:   </features>
Aug 03 00:07:49 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:07:49 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:07:49 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:07:49 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:07:49 user nova-compute[72520]:   </clock>
Aug 03 00:07:49 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:07:49 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:07:49 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:07:49 user nova-compute[72520]:   </cpu>
Aug 03 00:07:49 user nova-compute[72520]:   <devices>
Aug 03 00:07:49 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:07:49 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:07:49 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk"/>
Aug 03 00:07:49 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:07:49 user nova-compute[72520]:     </disk>
Aug 03 00:07:49 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:07:49 user nova-compute[72520]:       <mac address="fa:16:3e:df:dd:b1"/>
Aug 03 00:07:49 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:07:49 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:07:49 user nova-compute[72520]:       <target dev="tapfbd59173-10"/>
Aug 03 00:07:49 user nova-compute[72520]:     </interface>
Aug 03 00:07:49 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:07:49 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/console.log" append="off"/>
Aug 03 00:07:49 user nova-compute[72520]:     </serial>
Aug 03 00:07:49 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:07:49 user nova-compute[72520]:     <video>
Aug 03 00:07:49 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:07:49 user nova-compute[72520]:     </video>
Aug 03 00:07:49 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:07:49 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:07:49 user nova-compute[72520]:     </rng>
Aug 03 00:07:49 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:07:49 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:07:49 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:07:49 user nova-compute[72520]:     </memballoon>
Aug 03 00:07:49 user nova-compute[72520]:   </devices>
Aug 03 00:07:49 user nova-compute[72520]: </domain>
Aug 03 00:07:49 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-586457726',display_name='tempest-AttachVolumeTestJSON-server-586457726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-586457726',id=44,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgANd3VY3VOrcQytu5AFMPpnkTK/XiJT/0w/9tHuzvjIpRxDV60gTZztHNQv4/PdyLzZrWyB7iDiQkwmnKzH06A7dShubZ+1HQBLVmNS4C6JjAclOqp2Plz4JI3zkBeiA==',key_name='tempest-keypair-1255385236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-n24s7yhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=3c268d22-407c-4ae5-8b05-e7b7ba6046dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:dd:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbd59173-100b-4fa7-b3cb-6aeafad97145,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd59173-10') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG os_vif [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:dd:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbd59173-100b-4fa7-b3cb-6aeafad97145,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd59173-10') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbd59173-10, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbd59173-10, col_values=(('external_ids', {'iface-id': 'fbd59173-100b-4fa7-b3cb-6aeafad97145', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:dd:b1', 'vm-uuid': '3c268d22-407c-4ae5-8b05-e7b7ba6046dc'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:49 user nova-compute[72520]: INFO os_vif [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:dd:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbd59173-100b-4fa7-b3cb-6aeafad97145,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd59173-10')
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No VIF found with MAC fa:16:3e:df:dd:b1, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.neutron [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updated VIF entry in instance network info cache for port fbd59173-100b-4fa7-b3cb-6aeafad97145. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG nova.network.neutron [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updating instance_info_cache with network_info: [{"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:07:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-65146c20-4f0c-4d16-b0c0-cc23fc5aa7ab req-d28b9717-1c50-4e81-81a1-8a01487dbf5f service nova] Releasing lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:07:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e7f97f81-1612-4ab1-b355-b5b1fbfccbf6 req-d2f93c22-8600-41f0-9a4a-1403cda1a96f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e7f97f81-1612-4ab1-b355-b5b1fbfccbf6 req-d2f93c22-8600-41f0-9a4a-1403cda1a96f service nova] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e7f97f81-1612-4ab1-b355-b5b1fbfccbf6 req-d2f93c22-8600-41f0-9a4a-1403cda1a96f service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-e7f97f81-1612-4ab1-b355-b5b1fbfccbf6 req-d2f93c22-8600-41f0-9a4a-1403cda1a96f service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:51 user nova-compute[72520]: DEBUG nova.compute.manager [req-e7f97f81-1612-4ab1-b355-b5b1fbfccbf6 req-d2f93c22-8600-41f0-9a4a-1403cda1a96f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] No waiting events found dispatching network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:51 user nova-compute[72520]: WARNING nova.compute.manager [req-e7f97f81-1612-4ab1-b355-b5b1fbfccbf6 req-d2f93c22-8600-41f0-9a4a-1403cda1a96f service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received unexpected event network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 for instance with vm_state building and task_state spawning.
Aug 03 00:07:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021272.8762944, 3c268d22-407c-4ae5-8b05-e7b7ba6046dc => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:07:52 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] VM Resumed (Lifecycle Event)
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:07:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Instance spawned successfully.
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:07:52 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021272.880319, 3c268d22-407c-4ae5-8b05-e7b7ba6046dc => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:07:52 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] VM Started (Lifecycle Event)
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:07:53 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:07:53 user nova-compute[72520]: INFO nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 03 00:07:53 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:53 user nova-compute[72520]: INFO nova.compute.manager [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Took 6.05 seconds to build instance.
Aug 03 00:07:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-b3a18596-899e-4935-8a76-3f79469a9e68 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.148s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-7853dc0d-36ee-4399-a1be-72678d4d726f req-4d3e55ad-c74c-4eb2-b26a-484c7a53ea7e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:07:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7853dc0d-36ee-4399-a1be-72678d4d726f req-4d3e55ad-c74c-4eb2-b26a-484c7a53ea7e service nova] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:07:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7853dc0d-36ee-4399-a1be-72678d4d726f req-4d3e55ad-c74c-4eb2-b26a-484c7a53ea7e service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:07:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-7853dc0d-36ee-4399-a1be-72678d4d726f req-4d3e55ad-c74c-4eb2-b26a-484c7a53ea7e service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:07:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-7853dc0d-36ee-4399-a1be-72678d4d726f req-4d3e55ad-c74c-4eb2-b26a-484c7a53ea7e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] No waiting events found dispatching network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:07:53 user nova-compute[72520]: WARNING nova.compute.manager [req-7853dc0d-36ee-4399-a1be-72678d4d726f req-4d3e55ad-c74c-4eb2-b26a-484c7a53ea7e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received unexpected event network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 for instance with vm_state active and task_state None.
Aug 03 00:07:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:57 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021262.2941856, f3a7f181-b3b8-4688-a50a-3ecd6911a731 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:07:57 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] VM Stopped (Lifecycle Event)
Aug 03 00:07:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-675b8448-2a90-44cf-bf40-57ae70b10795 None None] [instance: f3a7f181-b3b8-4688-a50a-3ecd6911a731] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:07:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:07:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "2954a414-3633-4279-a326-092e1eef2256" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "2954a414-3633-4279-a326-092e1eef2256-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "2954a414-3633-4279-a326-092e1eef2256-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:08:08 user nova-compute[72520]: INFO nova.compute.manager [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Terminating instance
Aug 03 00:08:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-9d6f0797-a311-4775-94ab-71d7198d229c req-34998816-69db-4a14-998f-6fb189f8103b service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-vif-unplugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9d6f0797-a311-4775-94ab-71d7198d229c req-34998816-69db-4a14-998f-6fb189f8103b service nova] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9d6f0797-a311-4775-94ab-71d7198d229c req-34998816-69db-4a14-998f-6fb189f8103b service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9d6f0797-a311-4775-94ab-71d7198d229c req-34998816-69db-4a14-998f-6fb189f8103b service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-9d6f0797-a311-4775-94ab-71d7198d229c req-34998816-69db-4a14-998f-6fb189f8103b service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] No waiting events found dispatching network-vif-unplugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:08:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-9d6f0797-a311-4775-94ab-71d7198d229c req-34998816-69db-4a14-998f-6fb189f8103b service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-vif-unplugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:08:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 2954a414-3633-4279-a326-092e1eef2256] Instance destroyed successfully.
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.objects.instance [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'resources' on Instance uuid 2954a414-3633-4279-a326-092e1eef2256 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1259732456',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1259732456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1259732456',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwdgn2Qga1Y/v9K3xD4Zz+loZG05DbZg4mDhKQfvYTMrvWDcbq88RQspbc/issAd83Q+R03d2uN7RMe4wFbn0Itqk+g4oqosTxhtQ+SiBbY5xTGvvf4q5rl1LKh9RRlZA==',key_name='tempest-keypair-528872614',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:03:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-29d0vu5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=2954a414-3633-4279-a326-092e1eef2256,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "address": "fa:16:3e:58:14:dc", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7efb6cb9-bc", "ovs_interfaceid": "7efb6cb9-bc2d-4af7-8a96-9cc91f279cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:14:dc,bridge_name='br-int',has_traffic_filtering=True,id=7efb6cb9-bc2d-4af7-8a96-9cc91f279cef,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7efb6cb9-bc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_vif [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:14:dc,bridge_name='br-int',has_traffic_filtering=True,id=7efb6cb9-bc2d-4af7-8a96-9cc91f279cef,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7efb6cb9-bc') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7efb6cb9-bc, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:08:09 user nova-compute[72520]: INFO os_vif [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:14:dc,bridge_name='br-int',has_traffic_filtering=True,id=7efb6cb9-bc2d-4af7-8a96-9cc91f279cef,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7efb6cb9-bc')
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucWIfrND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:08:09 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a22289-3a5a-4596-ac6b-78b501977d29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[20621d71-1dfb-4900-8135-a13ee5a2b90e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:08:09 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e (non-flash)
Aug 03 00:08:09 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4408310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f0bbd-c262-4f94-801b-186d02ff6535]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f06162-d696-4bde-85cd-1cc6855ee990]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3aac3a-8615-42e7-8409-746cefb2b8cb]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597a1c5-914b-436a-b7fd-0958fd601ceb]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26161663738396335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cc528984', '/dev/disk/by-id/scsi-1SCST_BIOcc528984-aaf789c589fcda43') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07960b34-c7c3-4769-80a7-1786d404ce27]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f7d4b-157a-4c55-8e3e-90c3452cea52]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e8215-ccb3-428b-9a89-62c664912f35]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260]
Aug 03 00:08:09 user nova-compute[72520]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e, portal: 172.16.0.220,3260] successful.
Aug 03 00:08:09 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc31712a-0655-491b-a85c-219a26ad690e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0301f8-d56b-4fdb-9389-b06e9f629768]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== disconnect_volume: return (279ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:08:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Deleting instance files /opt/stack/data/nova/instances/2954a414-3633-4279-a326-092e1eef2256_del
Aug 03 00:08:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Deletion of /opt/stack/data/nova/instances/2954a414-3633-4279-a326-092e1eef2256_del complete
Aug 03 00:08:09 user nova-compute[72520]: INFO nova.compute.manager [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 03 00:08:09 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 2954a414-3633-4279-a326-092e1eef2256] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 2954a414-3633-4279-a326-092e1eef2256] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:08:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:10 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 2954a414-3633-4279-a326-092e1eef2256] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:08:10 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 2954a414-3633-4279-a326-092e1eef2256] Took 0.94 seconds to deallocate network for instance.
Aug 03 00:08:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-26224b8c-3a3e-44a7-84cb-f203ff41926a req-58b3058c-194f-4dab-b947-86b14fbeb6a6 service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-vif-deleted-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:08:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-3751eebf-fb91-4866-9485-84d96b5aa815 req-98ea78a2-65d1-493c-9089-cc1e616dd16d service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received event network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:08:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3751eebf-fb91-4866-9485-84d96b5aa815 req-98ea78a2-65d1-493c-9089-cc1e616dd16d service nova] Acquiring lock "2954a414-3633-4279-a326-092e1eef2256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:08:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3751eebf-fb91-4866-9485-84d96b5aa815 req-98ea78a2-65d1-493c-9089-cc1e616dd16d service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:08:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3751eebf-fb91-4866-9485-84d96b5aa815 req-98ea78a2-65d1-493c-9089-cc1e616dd16d service nova] Lock "2954a414-3633-4279-a326-092e1eef2256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:08:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-3751eebf-fb91-4866-9485-84d96b5aa815 req-98ea78a2-65d1-493c-9089-cc1e616dd16d service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] No waiting events found dispatching network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:08:10 user nova-compute[72520]: WARNING nova.compute.manager [req-3751eebf-fb91-4866-9485-84d96b5aa815 req-98ea78a2-65d1-493c-9089-cc1e616dd16d service nova] [instance: 2954a414-3633-4279-a326-092e1eef2256] Received unexpected event network-vif-plugged-7efb6cb9-bc2d-4af7-8a96-9cc91f279cef for instance with vm_state active and task_state deleting.
Aug 03 00:08:11 user nova-compute[72520]: INFO nova.compute.manager [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Took 0.86 seconds to detach 1 volumes for instance.
Aug 03 00:08:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 2954a414-3633-4279-a326-092e1eef2256] Deleting volume: cc31712a-0655-491b-a85c-219a26ad690e {{(pid=72520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 00:08:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:08:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:08:11 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:11 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:08:11 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:08:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:08:11 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Deleted allocations for instance 2954a414-3633-4279-a326-092e1eef2256
Aug 03 00:08:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-60fc37d6-2e45-415a-ab3c-2cc0ecd1f41b tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "2954a414-3633-4279-a326-092e1eef2256" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.325s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:08:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:08:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:15 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:08:16 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:08:16 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:08:16 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:08:16 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8340MB free_disk=25.21160125732422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:08:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:08:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 9e5e2748-c774-4e5b-a5be-96972d7120b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:08:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:08:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:08:24 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021289.0797582, 2954a414-3633-4279-a326-092e1eef2256 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:08:24 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 2954a414-3633-4279-a326-092e1eef2256] VM Stopped (Lifecycle Event)
Aug 03 00:08:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-4016e905-e0a6-4664-9519-2692ca4c5346 None None] [instance: 2954a414-3633-4279-a326-092e1eef2256] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:08:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:08:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:08:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:08:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:09:09 user nova-compute[72520]: INFO nova.compute.claims [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Claim successful on node user
Aug 03 00:09:09 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:09:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:09:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.policy [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12b66cf710fd4f70a7c9b722345a1c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333ffb679d840c99536aedc36be1232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:09:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Creating image(s)
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "/opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "/opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk 1073741824" returned: 0 in 0.048s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Cannot resize image /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lazy-loading 'migration_context' on Instance uuid 9bc042e2-58cd-482c-aa12-4fdec288a136 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Ensure instance console log exists: /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Successfully created port: 0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "0aadd692-2737-498e-8b26-ccec1278cadb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "0aadd692-2737-498e-8b26-ccec1278cadb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:09:11 user nova-compute[72520]: INFO nova.compute.claims [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Claim successful on node user
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:09:11 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Successfully updated port: 0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "refresh_cache-9bc042e2-58cd-482c-aa12-4fdec288a136" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquired lock "refresh_cache-9bc042e2-58cd-482c-aa12-4fdec288a136" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:09:11 user nova-compute[72520]: INFO nova.virt.block_device [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Booting with volume c91a3508-a173-4bd6-8a65-1b27dc45b8c7 at /dev/vda
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.policy [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f4f73d9df5413590eb77ae2b94090d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a710f41a5a44408a041238b388d588e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-changed-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Refreshing instance network info cache due to event network-changed-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] Acquiring lock "refresh_cache-9bc042e2-58cd-482c-aa12-4fdec288a136" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG os_brick.utils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f7f432-3d6c-40f9-9fb7-1a1e6161564c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5017c7-e2d3-432e-99a9-cf76cf7493a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8144b1ff-c8fd-4daf-9dae-ea24ff578be9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d497b74-528f-472f-8e9d-92f380f006fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:09:11 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:09:11 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17307c7b-01ea-4344-843f-abd0403571a8]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG os_brick.utils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Updating existing volume attachment record: 3b76a6d4-3d39-417e-8c07-21ee1679b1aa {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Updating instance_info_cache with network_info: [{"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Releasing lock "refresh_cache-9bc042e2-58cd-482c-aa12-4fdec288a136" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Instance network_info: |[{"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] Acquired lock "refresh_cache-9bc042e2-58cd-482c-aa12-4fdec288a136" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Refreshing network info cache for port 0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Start _get_guest_xml network_info=[{"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:09:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:09:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-129161393',display_name='tempest-VolumesActionsTest-instance-129161393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-129161393',id=45,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7333ffb679d840c99536aedc36be1232',ramdisk_id='',reservation_id='r-cq9dp5b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1919342088',owner_user_name='tempest-VolumesActionsTest-1919342088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:09:10Z,user_data=None,user_id='12b66cf710fd4f70a7c9b722345a1c10',uuid=9bc042e2-58cd-482c-aa12-4fdec288a136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converting VIF {"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:7d,bridge_name='br-int',has_traffic_filtering=True,id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0744dbb5-bc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.objects.instance [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bc042e2-58cd-482c-aa12-4fdec288a136 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:09:12 user nova-compute[72520]:   <uuid>9bc042e2-58cd-482c-aa12-4fdec288a136</uuid>
Aug 03 00:09:12 user nova-compute[72520]:   <name>instance-0000002d</name>
Aug 03 00:09:12 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:09:12 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:09:12 user nova-compute[72520]:   <metadata>
Aug 03 00:09:12 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:09:12 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:09:12 user nova-compute[72520]:       <nova:name>tempest-VolumesActionsTest-instance-129161393</nova:name>
Aug 03 00:09:12 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:09:12</nova:creationTime>
Aug 03 00:09:12 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:09:12 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:09:12 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:09:12 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:09:12 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:09:12 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:09:12 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:09:12 user nova-compute[72520]:       <nova:owner>
Aug 03 00:09:12 user nova-compute[72520]:         <nova:user uuid="12b66cf710fd4f70a7c9b722345a1c10">tempest-VolumesActionsTest-1919342088-project-member</nova:user>
Aug 03 00:09:12 user nova-compute[72520]:         <nova:project uuid="7333ffb679d840c99536aedc36be1232">tempest-VolumesActionsTest-1919342088</nova:project>
Aug 03 00:09:12 user nova-compute[72520]:       </nova:owner>
Aug 03 00:09:12 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:09:12 user nova-compute[72520]:       <nova:ports>
Aug 03 00:09:12 user nova-compute[72520]:         <nova:port uuid="0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14">
Aug 03 00:09:12 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 03 00:09:12 user nova-compute[72520]:         </nova:port>
Aug 03 00:09:12 user nova-compute[72520]:       </nova:ports>
Aug 03 00:09:12 user nova-compute[72520]:     </nova:instance>
Aug 03 00:09:12 user nova-compute[72520]:   </metadata>
Aug 03 00:09:12 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:09:12 user nova-compute[72520]:     <system>
Aug 03 00:09:12 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:09:12 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:09:12 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:09:12 user nova-compute[72520]:       <entry name="serial">9bc042e2-58cd-482c-aa12-4fdec288a136</entry>
Aug 03 00:09:12 user nova-compute[72520]:       <entry name="uuid">9bc042e2-58cd-482c-aa12-4fdec288a136</entry>
Aug 03 00:09:12 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:09:12 user nova-compute[72520]:     </system>
Aug 03 00:09:12 user nova-compute[72520]:   </sysinfo>
Aug 03 00:09:12 user nova-compute[72520]:   <os>
Aug 03 00:09:12 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:09:12 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:09:12 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:09:12 user nova-compute[72520]:   </os>
Aug 03 00:09:12 user nova-compute[72520]:   <features>
Aug 03 00:09:12 user nova-compute[72520]:     <acpi/>
Aug 03 00:09:12 user nova-compute[72520]:     <apic/>
Aug 03 00:09:12 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:09:12 user nova-compute[72520]:   </features>
Aug 03 00:09:12 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:09:12 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:09:12 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:09:12 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:09:12 user nova-compute[72520]:   </clock>
Aug 03 00:09:12 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:09:12 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:09:12 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:09:12 user nova-compute[72520]:   </cpu>
Aug 03 00:09:12 user nova-compute[72520]:   <devices>
Aug 03 00:09:12 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:09:12 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:09:12 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk"/>
Aug 03 00:09:12 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:09:12 user nova-compute[72520]:     </disk>
Aug 03 00:09:12 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:09:12 user nova-compute[72520]:       <mac address="fa:16:3e:34:84:7d"/>
Aug 03 00:09:12 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:09:12 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:09:12 user nova-compute[72520]:       <target dev="tap0744dbb5-bc"/>
Aug 03 00:09:12 user nova-compute[72520]:     </interface>
Aug 03 00:09:12 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:09:12 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/console.log" append="off"/>
Aug 03 00:09:12 user nova-compute[72520]:     </serial>
Aug 03 00:09:12 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:09:12 user nova-compute[72520]:     <video>
Aug 03 00:09:12 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:09:12 user nova-compute[72520]:     </video>
Aug 03 00:09:12 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:09:12 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:09:12 user nova-compute[72520]:     </rng>
Aug 03 00:09:12 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:09:12 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:09:12 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:09:12 user nova-compute[72520]:     </memballoon>
Aug 03 00:09:12 user nova-compute[72520]:   </devices>
Aug 03 00:09:12 user nova-compute[72520]: </domain>
Aug 03 00:09:12 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-129161393',display_name='tempest-VolumesActionsTest-instance-129161393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-129161393',id=45,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7333ffb679d840c99536aedc36be1232',ramdisk_id='',reservation_id='r-cq9dp5b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1919342088',owner_user_name='tempest-VolumesActionsTest-1919342088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:09:10Z,user_data=None,user_id='12b66cf710fd4f70a7c9b722345a1c10',uuid=9bc042e2-58cd-482c-aa12-4fdec288a136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converting VIF {"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:7d,bridge_name='br-int',has_traffic_filtering=True,id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0744dbb5-bc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG os_vif [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:7d,bridge_name='br-int',has_traffic_filtering=True,id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0744dbb5-bc') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0744dbb5-bc, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0744dbb5-bc, col_values=(('external_ids', {'iface-id': '0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:84:7d', 'vm-uuid': '9bc042e2-58cd-482c-aa12-4fdec288a136'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:12 user nova-compute[72520]: INFO os_vif [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:7d,bridge_name='br-int',has_traffic_filtering=True,id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0744dbb5-bc')
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] No VIF found with MAC fa:16:3e:34:84:7d, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Successfully created port: 1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Updated VIF entry in instance network info cache for port 0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Updating instance_info_cache with network_info: [{"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:09:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-33e200ec-67f0-476a-862d-d6ae331b8bfd req-f035c697-0e63-49a1-b668-759483b100e9 service nova] Releasing lock "refresh_cache-9bc042e2-58cd-482c-aa12-4fdec288a136" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Successfully updated port: 1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquired lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-changed-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Refreshing instance network info cache due to event network-changed-1fe7b63e-919b-4b9e-af08-505d4e7db0f3. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] Acquiring lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.network.neutron [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Updating instance_info_cache with network_info: [{"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Releasing lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Instance network_info: |[{"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] Acquired lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Refreshing network info cache for port 1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-9fbf5b2d-bba9-479b-b7d4-f8b3f09a33a4 req-ebbe7659-1495-458f-8669-6d55bde192af service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9fbf5b2d-bba9-479b-b7d4-f8b3f09a33a4 req-ebbe7659-1495-458f-8669-6d55bde192af service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9fbf5b2d-bba9-479b-b7d4-f8b3f09a33a4 req-ebbe7659-1495-458f-8669-6d55bde192af service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9fbf5b2d-bba9-479b-b7d4-f8b3f09a33a4 req-ebbe7659-1495-458f-8669-6d55bde192af service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-9fbf5b2d-bba9-479b-b7d4-f8b3f09a33a4 req-ebbe7659-1495-458f-8669-6d55bde192af service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:09:13 user nova-compute[72520]: WARNING nova.compute.manager [req-9fbf5b2d-bba9-479b-b7d4-f8b3f09a33a4 req-ebbe7659-1495-458f-8669-6d55bde192af service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received unexpected event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with vm_state building and task_state spawning.
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Updated VIF entry in instance network info cache for port 1fe7b63e-919b-4b9e-af08-505d4e7db0f3. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.network.neutron [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Updating instance_info_cache with network_info: [{"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-139ed1bf-8a65-4be2-b741-24ea170db8eb req-42003cb0-2077-4dcd-a2f6-5a0578b44d48 service nova] Releasing lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Skipping network cache update for instance because it is Building. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Skipping network cache update for instance because it is Building. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:09:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021355.722725, 9bc042e2-58cd-482c-aa12-4fdec288a136 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:09:15 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] VM Resumed (Lifecycle Event)
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:09:15 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Instance spawned successfully.
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:09:15 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021355.7244637, 9bc042e2-58cd-482c-aa12-4fdec288a136 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:09:15 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] VM Started (Lifecycle Event)
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:09:15 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:09:15 user nova-compute[72520]: INFO nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:09:15 user nova-compute[72520]: INFO nova.compute.manager [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Took 6.38 seconds to build instance.
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-2ae735ee-7c3c-4c97-886d-7a0a81c0ee7d req-c95ed679-0981-4978-8064-ca791c80d123 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ae735ee-7c3c-4c97-886d-7a0a81c0ee7d req-c95ed679-0981-4978-8064-ca791c80d123 service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ae735ee-7c3c-4c97-886d-7a0a81c0ee7d req-c95ed679-0981-4978-8064-ca791c80d123 service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2ae735ee-7c3c-4c97-886d-7a0a81c0ee7d req-c95ed679-0981-4978-8064-ca791c80d123 service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:15 user nova-compute[72520]: DEBUG nova.compute.manager [req-2ae735ee-7c3c-4c97-886d-7a0a81c0ee7d req-c95ed679-0981-4978-8064-ca791c80d123 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:09:15 user nova-compute[72520]: WARNING nova.compute.manager [req-2ae735ee-7c3c-4c97-886d-7a0a81c0ee7d req-c95ed679-0981-4978-8064-ca791c80d123 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received unexpected event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with vm_state active and task_state None.
Aug 03 00:09:15 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-cf274541-f325-440c-b0b9-4199e86aaf17 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.484s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:09:19 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8369MB free_disk=25.20648193359375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 9e5e2748-c774-4e5b-a5be-96972d7120b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 9bc042e2-58cd-482c-aa12-4fdec288a136 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0aadd692-2737-498e-8b26-ccec1278cadb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:09:19 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Creating image(s)
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Ensure instance console log exists: /opt/stack/data/nova/instances/0aadd692-2737-498e-8b26-ccec1278cadb/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Start _get_guest_xml network_info=[{"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0aadd692-2737-498e-8b26-ccec1278cadb', 'attached_at': '', 'detached_at': '', 'volume_id': 'c91a3508-a173-4bd6-8a65-1b27dc45b8c7', 'serial': 'c91a3508-a173-4bd6-8a65-1b27dc45b8c7'}, 'attachment_id': '3b76a6d4-3d39-417e-8c07-21ee1679b1aa', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:09:19 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:09:19 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:09:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:09:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:09:19 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:09:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b3016b-a040-4a3e-adfd-a05dba2459f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:09:19 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[728a44e3-0974-4920-89a3-0edb0cda1a18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7] added
Aug 03 00:09:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e590accc-f64f-4788-9a8e-80bc6d877e64]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe1876-fdf1-41ed-a549-7305041d8a39]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJVHPCXB {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJVHPCXB" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[008f75eb-711b-4ebe-bddd-b8ccfad56f2e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJVHPCXB'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9f40c1-f7c3-4e92-b83b-9db1ec05e704]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5384ad7c-94f0-46be-a959-a0056d618d99]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:09:19 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:09:19 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:09:19 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:09:19 user nova-compute[72520]: 
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[383af84b-178a-4688-966d-65bdc0cfd61d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]
Aug 03 00:09:19 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.
Aug 03 00:09:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63de770-ac0f-4eef-be71-89f4f3803add]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[878b0082-8d8b-4ddd-969c-8586eaf46997]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:09:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:09:19 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5405a53-c877-4338-bfca-b620425cef3a]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:09:19 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23265346534336331', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265346534336331', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-273945765',display_name='tempest-TestVolumeBootPattern-server-273945765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-273945765',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-y0dbjr5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:09:12Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=0aadd692-2737-498e-8b26-ccec1278cadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:97:3c,bridge_name='br-int',has_traffic_filtering=True,id=1fe7b63e-919b-4b9e-af08-505d4e7db0f3,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe7b63e-91') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.objects.instance [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aadd692-2737-498e-8b26-ccec1278cadb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:09:20 user nova-compute[72520]:   <uuid>0aadd692-2737-498e-8b26-ccec1278cadb</uuid>
Aug 03 00:09:20 user nova-compute[72520]:   <name>instance-0000002e</name>
Aug 03 00:09:20 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:09:20 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:09:20 user nova-compute[72520]:   <metadata>
Aug 03 00:09:20 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:09:20 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:09:20 user nova-compute[72520]:       <nova:name>tempest-TestVolumeBootPattern-server-273945765</nova:name>
Aug 03 00:09:20 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:09:19</nova:creationTime>
Aug 03 00:09:20 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:09:20 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:09:20 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:09:20 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:09:20 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:09:20 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:09:20 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:09:20 user nova-compute[72520]:       <nova:owner>
Aug 03 00:09:20 user nova-compute[72520]:         <nova:user uuid="53f4f73d9df5413590eb77ae2b94090d">tempest-TestVolumeBootPattern-1675749395-project-member</nova:user>
Aug 03 00:09:20 user nova-compute[72520]:         <nova:project uuid="4a710f41a5a44408a041238b388d588e">tempest-TestVolumeBootPattern-1675749395</nova:project>
Aug 03 00:09:20 user nova-compute[72520]:       </nova:owner>
Aug 03 00:09:20 user nova-compute[72520]:       <nova:ports>
Aug 03 00:09:20 user nova-compute[72520]:         <nova:port uuid="1fe7b63e-919b-4b9e-af08-505d4e7db0f3">
Aug 03 00:09:20 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 00:09:20 user nova-compute[72520]:         </nova:port>
Aug 03 00:09:20 user nova-compute[72520]:       </nova:ports>
Aug 03 00:09:20 user nova-compute[72520]:     </nova:instance>
Aug 03 00:09:20 user nova-compute[72520]:   </metadata>
Aug 03 00:09:20 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:09:20 user nova-compute[72520]:     <system>
Aug 03 00:09:20 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:09:20 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:09:20 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:09:20 user nova-compute[72520]:       <entry name="serial">0aadd692-2737-498e-8b26-ccec1278cadb</entry>
Aug 03 00:09:20 user nova-compute[72520]:       <entry name="uuid">0aadd692-2737-498e-8b26-ccec1278cadb</entry>
Aug 03 00:09:20 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:09:20 user nova-compute[72520]:     </system>
Aug 03 00:09:20 user nova-compute[72520]:   </sysinfo>
Aug 03 00:09:20 user nova-compute[72520]:   <os>
Aug 03 00:09:20 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:09:20 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:09:20 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:09:20 user nova-compute[72520]:   </os>
Aug 03 00:09:20 user nova-compute[72520]:   <features>
Aug 03 00:09:20 user nova-compute[72520]:     <acpi/>
Aug 03 00:09:20 user nova-compute[72520]:     <apic/>
Aug 03 00:09:20 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:09:20 user nova-compute[72520]:   </features>
Aug 03 00:09:20 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:09:20 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:09:20 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:09:20 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:09:20 user nova-compute[72520]:   </clock>
Aug 03 00:09:20 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:09:20 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:09:20 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:09:20 user nova-compute[72520]:   </cpu>
Aug 03 00:09:20 user nova-compute[72520]:   <devices>
Aug 03 00:09:20 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:09:20 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:09:20 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 03 00:09:20 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:09:20 user nova-compute[72520]:       <serial>c91a3508-a173-4bd6-8a65-1b27dc45b8c7</serial>
Aug 03 00:09:20 user nova-compute[72520]:     </disk>
Aug 03 00:09:20 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:09:20 user nova-compute[72520]:       <mac address="fa:16:3e:4b:97:3c"/>
Aug 03 00:09:20 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:09:20 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:09:20 user nova-compute[72520]:       <target dev="tap1fe7b63e-91"/>
Aug 03 00:09:20 user nova-compute[72520]:     </interface>
Aug 03 00:09:20 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:09:20 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0aadd692-2737-498e-8b26-ccec1278cadb/console.log" append="off"/>
Aug 03 00:09:20 user nova-compute[72520]:     </serial>
Aug 03 00:09:20 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:09:20 user nova-compute[72520]:     <video>
Aug 03 00:09:20 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:09:20 user nova-compute[72520]:     </video>
Aug 03 00:09:20 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:09:20 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:09:20 user nova-compute[72520]:     </rng>
Aug 03 00:09:20 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:09:20 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:09:20 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:09:20 user nova-compute[72520]:     </memballoon>
Aug 03 00:09:20 user nova-compute[72520]:   </devices>
Aug 03 00:09:20 user nova-compute[72520]: </domain>
Aug 03 00:09:20 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-273945765',display_name='tempest-TestVolumeBootPattern-server-273945765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-273945765',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-y0dbjr5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:09:12Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=0aadd692-2737-498e-8b26-ccec1278cadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:97:3c,bridge_name='br-int',has_traffic_filtering=True,id=1fe7b63e-919b-4b9e-af08-505d4e7db0f3,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe7b63e-91') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG os_vif [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:97:3c,bridge_name='br-int',has_traffic_filtering=True,id=1fe7b63e-919b-4b9e-af08-505d4e7db0f3,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe7b63e-91') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fe7b63e-91, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1fe7b63e-91, col_values=(('external_ids', {'iface-id': '1fe7b63e-919b-4b9e-af08-505d4e7db0f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:97:3c', 'vm-uuid': '0aadd692-2737-498e-8b26-ccec1278cadb'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:09:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:20 user nova-compute[72520]: INFO os_vif [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:97:3c,bridge_name='br-int',has_traffic_filtering=True,id=1fe7b63e-919b-4b9e-af08-505d4e7db0f3,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe7b63e-91')
Aug 03 00:09:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:09:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No VIF found with MAC fa:16:3e:4b:97:3c, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:09:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-6f0b0b2e-3379-47e2-a998-1eef4bf740a9 req-4d5e5f93-bf0f-44c1-aebc-592ccb2a4124 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6f0b0b2e-3379-47e2-a998-1eef4bf740a9 req-4d5e5f93-bf0f-44c1-aebc-592ccb2a4124 service nova] Acquiring lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6f0b0b2e-3379-47e2-a998-1eef4bf740a9 req-4d5e5f93-bf0f-44c1-aebc-592ccb2a4124 service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6f0b0b2e-3379-47e2-a998-1eef4bf740a9 req-4d5e5f93-bf0f-44c1-aebc-592ccb2a4124 service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG nova.compute.manager [req-6f0b0b2e-3379-47e2-a998-1eef4bf740a9 req-4d5e5f93-bf0f-44c1-aebc-592ccb2a4124 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] No waiting events found dispatching network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:09:22 user nova-compute[72520]: WARNING nova.compute.manager [req-6f0b0b2e-3379-47e2-a998-1eef4bf740a9 req-4d5e5f93-bf0f-44c1-aebc-592ccb2a4124 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received unexpected event network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 for instance with vm_state building and task_state spawning.
Aug 03 00:09:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021364.3735688, 0aadd692-2737-498e-8b26-ccec1278cadb => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:09:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] VM Resumed (Lifecycle Event)
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:09:24 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Instance spawned successfully.
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:09:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021364.374607, 0aadd692-2737-498e-8b26-ccec1278cadb => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:09:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] VM Started (Lifecycle Event)
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:09:24 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:09:24 user nova-compute[72520]: INFO nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:09:24 user nova-compute[72520]: INFO nova.compute.manager [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Took 13.23 seconds to build instance.
Aug 03 00:09:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-66a1059c-74ae-4697-b2fd-c03392b2800d tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "0aadd692-2737-498e-8b26-ccec1278cadb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.345s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-d8c53649-1d46-463c-a841-485e3b929363 req-4c985e3f-5158-4b31-a6e1-2a1eea568820 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8c53649-1d46-463c-a841-485e3b929363 req-4c985e3f-5158-4b31-a6e1-2a1eea568820 service nova] Acquiring lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8c53649-1d46-463c-a841-485e3b929363 req-4c985e3f-5158-4b31-a6e1-2a1eea568820 service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8c53649-1d46-463c-a841-485e3b929363 req-4c985e3f-5158-4b31-a6e1-2a1eea568820 service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:24 user nova-compute[72520]: DEBUG nova.compute.manager [req-d8c53649-1d46-463c-a841-485e3b929363 req-4c985e3f-5158-4b31-a6e1-2a1eea568820 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] No waiting events found dispatching network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:09:24 user nova-compute[72520]: WARNING nova.compute.manager [req-d8c53649-1d46-463c-a841-485e3b929363 req-4c985e3f-5158-4b31-a6e1-2a1eea568820 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received unexpected event network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 for instance with vm_state active and task_state None.
Aug 03 00:09:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:28 user nova-compute[72520]: INFO nova.compute.manager [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Terminating instance
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-9d284f86-e71f-47db-89c8-2a8cd2f886b0 req-07b8c368-deff-4ee4-bf38-004530a6d7d2 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received event network-vif-unplugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9d284f86-e71f-47db-89c8-2a8cd2f886b0 req-07b8c368-deff-4ee4-bf38-004530a6d7d2 service nova] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9d284f86-e71f-47db-89c8-2a8cd2f886b0 req-07b8c368-deff-4ee4-bf38-004530a6d7d2 service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-9d284f86-e71f-47db-89c8-2a8cd2f886b0 req-07b8c368-deff-4ee4-bf38-004530a6d7d2 service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-9d284f86-e71f-47db-89c8-2a8cd2f886b0 req-07b8c368-deff-4ee4-bf38-004530a6d7d2 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] No waiting events found dispatching network-vif-unplugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.compute.manager [req-9d284f86-e71f-47db-89c8-2a8cd2f886b0 req-07b8c368-deff-4ee4-bf38-004530a6d7d2 service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received event network-vif-unplugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:28 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Instance destroyed successfully.
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.objects.instance [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lazy-loading 'resources' on Instance uuid 9e5e2748-c774-4e5b-a5be-96972d7120b9 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1248791340',display_name='tempest-ServersNegativeTestJSON-server-1248791340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1248791340',id=43,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:07:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b23638b890649bebd9d3be398b9451d',ramdisk_id='',reservation_id='r-9pm67cz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-80248803',owner_user_name='tempest-ServersNegativeTestJSON-80248803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:07:44Z,user_data=None,user_id='6361183670f8430ab54cdbcd5f40f8de',uuid=9e5e2748-c774-4e5b-a5be-96972d7120b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converting VIF {"id": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "address": "fa:16:3e:85:78:25", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9e7d7e-ed", "ovs_interfaceid": "df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:25,bridge_name='br-int',has_traffic_filtering=True,id=df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9e7d7e-ed') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG os_vif [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:25,bridge_name='br-int',has_traffic_filtering=True,id=df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9e7d7e-ed') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf9e7d7e-ed, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:09:28 user nova-compute[72520]: INFO os_vif [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:25,bridge_name='br-int',has_traffic_filtering=True,id=df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9e7d7e-ed')
Aug 03 00:09:28 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Deleting instance files /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9_del
Aug 03 00:09:28 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Deletion of /opt/stack/data/nova/instances/9e5e2748-c774-4e5b-a5be-96972d7120b9_del complete
Aug 03 00:09:28 user nova-compute[72520]: INFO nova.compute.manager [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 03 00:09:28 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:09:28 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:09:29 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:09:29 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Took 0.51 seconds to deallocate network for instance.
Aug 03 00:09:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:29 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:09:29 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:09:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:29 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Deleted allocations for instance 9e5e2748-c774-4e5b-a5be-96972d7120b9
Aug 03 00:09:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-96fdf8b9-75f4-419f-b6c4-443fe0c69d19 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:30 user nova-compute[72520]: DEBUG nova.compute.manager [req-58b04c6f-feb9-480c-9cbf-04eb45c54f85 req-0c7970b8-4275-4f40-9202-55ebd5c9d6da service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received event network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-58b04c6f-feb9-480c-9cbf-04eb45c54f85 req-0c7970b8-4275-4f40-9202-55ebd5c9d6da service nova] Acquiring lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-58b04c6f-feb9-480c-9cbf-04eb45c54f85 req-0c7970b8-4275-4f40-9202-55ebd5c9d6da service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-58b04c6f-feb9-480c-9cbf-04eb45c54f85 req-0c7970b8-4275-4f40-9202-55ebd5c9d6da service nova] Lock "9e5e2748-c774-4e5b-a5be-96972d7120b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:30 user nova-compute[72520]: DEBUG nova.compute.manager [req-58b04c6f-feb9-480c-9cbf-04eb45c54f85 req-0c7970b8-4275-4f40-9202-55ebd5c9d6da service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] No waiting events found dispatching network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:09:30 user nova-compute[72520]: WARNING nova.compute.manager [req-58b04c6f-feb9-480c-9cbf-04eb45c54f85 req-0c7970b8-4275-4f40-9202-55ebd5c9d6da service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received unexpected event network-vif-plugged-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 for instance with vm_state deleted and task_state None.
Aug 03 00:09:30 user nova-compute[72520]: DEBUG nova.compute.manager [req-58b04c6f-feb9-480c-9cbf-04eb45c54f85 req-0c7970b8-4275-4f40-9202-55ebd5c9d6da service nova] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Received event network-vif-deleted-df9e7d7e-ed9a-4ffd-b8a8-34e0b044ea46 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:09:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-changed-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:09:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Refreshing instance network info cache due to event network-changed-fbd59173-100b-4fa7-b3cb-6aeafad97145. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:09:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] Acquiring lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:09:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] Acquired lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:09:38 user nova-compute[72520]: DEBUG nova.network.neutron [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Refreshing network info cache for port fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:09:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updated VIF entry in instance network info cache for port fbd59173-100b-4fa7-b3cb-6aeafad97145. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:09:39 user nova-compute[72520]: DEBUG nova.network.neutron [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updating instance_info_cache with network_info: [{"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:09:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c59a6efe-0182-4395-a521-f994574066a6 req-dcdfefcf-05d8-4004-8ff6-98163100b47e service nova] Releasing lock "refresh_cache-3c268d22-407c-4ae5-8b05-e7b7ba6046dc" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:09:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG nova.objects.instance [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:43 user nova-compute[72520]: INFO nova.compute.manager [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Attaching volume 6805e6c4-9f3c-429c-b5f0-e33f85504aa6 to /dev/vdb
Aug 03 00:09:43 user nova-compute[72520]: DEBUG os_brick.utils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1561ed-cddb-4a0a-be48-c38b8a2933d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8948f-fc32-4cd2-9df1-20ebe2c16619]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34999eff-018d-461a-ae7c-822b12562949]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0923928d-e7de-4750-972c-83d3a68b080e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:09:43 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:09:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44458dc1-7f2d-4c17-8cb7-07041135f73c]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG os_brick.utils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updating existing volume attachment record: 2eb04de0-94a6-466e-b783-99eb645b8787 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021368.8048537, 9e5e2748-c774-4e5b-a5be-96972d7120b9 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:09:43 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] VM Stopped (Lifecycle Event)
Aug 03 00:09:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9c3f2be7-bc97-430b-9a9c-7113b7adfb60 None None] [instance: 9e5e2748-c774-4e5b-a5be-96972d7120b9] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:09:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKiewpIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:09:50 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:09:50 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:09:50 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1948360-e47f-49cb-9c9d-7a564a3de703]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:09:50 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e1f2c5-d9e8-4b48-ac89-2d43daf8b423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6] added
Aug 03 00:09:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbd21bb-cbae-479a-aa2b-535eb317653b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36089ea4-0608-4708-a7b0-549505fb73e8]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKiewpIs {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKiewpIs" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e9b590-8b0c-4bbc-a165-7e6bf5b64d9d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKiewpIs'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ee80c-8ee1-4e1f-b2ca-275d9f6cc2fc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aad40f-3e5d-450a-b458-5d1a511f35db]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:09:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:09:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:09:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[22528bdb-9d91-441d-9c87-e5ceb05e9c35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260]
Aug 03 00:09:51 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260] successful.
Aug 03 00:09:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[75818814-3269-4931-a754-cb0bbbfc4560]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1799d896-115f-41c1-aa0b-b085448061ba]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:09:51 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:09:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:09:51 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:09:51 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f0bed2-8834-45ae-99b5-0039dbe8e8cd]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:09:51 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKiewpIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23233366263353263', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233366263353263', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG nova.objects.instance [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:09:52 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:09:52 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 03 00:09:52 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:09:52 user nova-compute[72520]:   <serial>6805e6c4-9f3c-429c-b5f0-e33f85504aa6</serial>
Aug 03 00:09:52 user nova-compute[72520]: </disk>
Aug 03 00:09:52 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No VIF found with MAC fa:16:3e:df:dd:b1, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:09:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-0fbc7e9f-1df5-4b48-aefc-4dfbb3014228 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.178s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:09:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:56 user nova-compute[72520]: DEBUG nova.objects.instance [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:09:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:09:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:09:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:09:56 user nova-compute[72520]: INFO nova.compute.manager [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Attaching volume c6815782-438d-470b-86e2-78870c206f28 to /dev/vdc
Aug 03 00:09:57 user nova-compute[72520]: DEBUG os_brick.utils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b954b-2501-4a6a-8252-fd3692ceab13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea02fd-dbe9-4e4c-b30f-ab75c86f4848]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e41fd-784a-4cae-a425-36b532b0ae8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b52627c-6fc3-415a-a84a-59337be57549]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:09:57 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:09:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3376c38-d32e-479c-b0ed-3aa3b8021562]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG os_brick.utils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:09:57 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updating existing volume attachment record: d0126d2b-f214-4091-854e-facb798e2717 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:09:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:10:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:10:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:10:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKtaIsNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:10:04 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:10:04 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:10:04 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc982b9a-d5d2-4469-b28f-fe4d1313d2e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:10:04 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a7335-608f-430c-8ace-42ffba5b687f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28] added
Aug 03 00:10:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae39de-7463-4c80-a1a2-d226ee83c9f6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16419aa-25b5-4c75-befe-1a95e62a1e60]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKtaIsNe {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKtaIsNe" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579fd93-a58f-4ba1-ab41-279e9b3e9f61]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKtaIsNe'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d11eef-9efe-4df6-aca7-de3d5e6828a4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c7aa8-4ff9-405a-93e8-4e2410fa0271]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d960d5-8ed1-4160-8bf1-e76f736a45fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260]
Aug 03 00:10:04 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260] successful.
Aug 03 00:10:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6fc9d7-3d5d-4075-96e5-acb7377d2756]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7146407-17a7-43a9-ac31-23941b3e0290]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)
Aug 03 00:10:04 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ccede3-85a2-4ea6-890b-46b43ff78ede]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:04 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:10:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:10:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKtaIsNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:10:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:10:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23739666462663838', 'path': '/dev/sdd'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:10:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739666462663838', 'path': '/dev/sdd'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:10:05 user nova-compute[72520]: DEBUG nova.objects.instance [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:10:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:10:05 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:10:05 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 03 00:10:05 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 03 00:10:05 user nova-compute[72520]:   <serial>c6815782-438d-470b-86e2-78870c206f28</serial>
Aug 03 00:10:05 user nova-compute[72520]: </disk>
Aug 03 00:10:05 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:10:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:10:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:10:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:10:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] No VIF found with MAC fa:16:3e:df:dd:b1, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:10:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-e901f47b-4e6b-4798-a297-2ad961080f3f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.417s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:07 user nova-compute[72520]: INFO nova.compute.manager [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Detaching volume 6805e6c4-9f3c-429c-b5f0-e33f85504aa6
Aug 03 00:10:07 user nova-compute[72520]: INFO nova.virt.block_device [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Attempting to driver detach volume 6805e6c4-9f3c-429c-b5f0-e33f85504aa6 from mountpoint /dev/vdb
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Attempting to detach device vdb from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:10:07 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:10:07 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 03 00:10:07 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:10:07 user nova-compute[72520]:   <serial>6805e6c4-9f3c-429c-b5f0-e33f85504aa6</serial>
Aug 03 00:10:07 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:10:07 user nova-compute[72520]: </disk>
Aug 03 00:10:07 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:10:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully detached device vdb from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the persistent domain config.
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:10:07 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:10:07 user nova-compute[72520]:   <source dev="/dev/sdc"/>
Aug 03 00:10:07 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:10:07 user nova-compute[72520]:   <serial>6805e6c4-9f3c-429c-b5f0-e33f85504aa6</serial>
Aug 03 00:10:07 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:10:07 user nova-compute[72520]: </disk>
Aug 03 00:10:07 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691021407.6727934, 3c268d22-407c-4ae5-8b05-e7b7ba6046dc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:10:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully detached device vdb from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the live domain config.
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKiewpIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:10:07 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[04980612-8adb-4712-af13-d695f905851b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50448a1-78d6-436c-b2cd-0c7704cc27ac]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:07 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:10:07 user nova-compute[72520]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)
Aug 03 00:10:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:07 user nova-compute[72520]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 (non-flash)
Aug 03 00:10:07 user nova-compute[72520]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)
Aug 03 00:10:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce427bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8eedd-d142-4d4f-bc09-81b8c3a542ed]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a936ef62-3b9e-4572-9595-a37456421f5a]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8226b84-aa86-43ce-b6f8-9104b1a8bb82]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1516b3-271c-47ae-9557-426189656822]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7e1053-5caf-4078-bcb3-9bbafb778a70]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c337c-41ee-489a-bbf4-e734a4fae100]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260]
Aug 03 00:10:07 user nova-compute[72520]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6, portal: 172.16.0.220,3260] successful.
Aug 03 00:10:07 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6805e6c4-9f3c-429c-b5f0-e33f85504aa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d8c61-4c25-4232-84e9-94fe02623f01]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== disconnect_volume: return (310ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:10:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:10:08 user nova-compute[72520]: DEBUG nova.objects.instance [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:10:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-aeac90f3-7001-4896-aac4-cf51c790fe2f tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.788s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:09 user nova-compute[72520]: INFO nova.compute.manager [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Detaching volume c6815782-438d-470b-86e2-78870c206f28
Aug 03 00:10:09 user nova-compute[72520]: INFO nova.virt.block_device [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Attempting to driver detach volume c6815782-438d-470b-86e2-78870c206f28 from mountpoint /dev/vdc
Aug 03 00:10:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Attempting to detach device vdc from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:10:09 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:10:09 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 03 00:10:09 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 03 00:10:09 user nova-compute[72520]:   <serial>c6815782-438d-470b-86e2-78870c206f28</serial>
Aug 03 00:10:09 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 00:10:09 user nova-compute[72520]: </disk>
Aug 03 00:10:09 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:10:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully detached device vdc from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the persistent domain config.
Aug 03 00:10:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:10:09 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:10:09 user nova-compute[72520]:   <source dev="/dev/sdd"/>
Aug 03 00:10:09 user nova-compute[72520]:   <target dev="vdc" bus="virtio"/>
Aug 03 00:10:09 user nova-compute[72520]:   <serial>c6815782-438d-470b-86e2-78870c206f28</serial>
Aug 03 00:10:09 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 00:10:09 user nova-compute[72520]: </disk>
Aug 03 00:10:09 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691021409.9812908, 3c268d22-407c-4ae5-8b05-e7b7ba6046dc => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:10:09 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully detached device vdc from instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc from the live domain config.
Aug 03 00:10:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKtaIsNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:10:09 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:10:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:10:09 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61f7053-6c65-4e10-81cc-b277904cc1ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4956ba60-3cd0-4744-836a-7021f7392c03]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:10 user nova-compute[72520]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)
Aug 03 00:10:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:10:10 user nova-compute[72520]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 (non-flash)
Aug 03 00:10:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cc47a9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28'): ({'sdd'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Removing single pathed devices sdd {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd2ea2-e505-47ab-9fce-ef093c4d63ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad86b0d7-faf5-4806-8784-1eb5cd7af529]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Flushing IO for device /dev/sdd {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[845382ae-206e-436a-847e-835782e6aa7d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cf039a-9642-4b48-808c-9f15e8bc11ea]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] SCSI volumes sdd have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbaefe5-392b-413d-b667-64313f96738b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[81828c7b-8a4a-4ecc-9d44-1758f1b55d14]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260]
Aug 03 00:10:10 user nova-compute[72520]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28, portal: 172.16.0.220,3260] successful.
Aug 03 00:10:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6815782-438d-470b-86e2-78870c206f28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8907693a-354d-4f04-8db2-fdf38c762bf4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] <== disconnect_volume: return (250ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:10:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:10:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'flavor' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:10:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-476b0743-be47-4fce-b98d-64574547f419 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:12 user nova-compute[72520]: INFO nova.compute.manager [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Terminating instance
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-431e6a01-4f0a-4d59-bbcf-69f483391aec req-fad21379-6ea1-476e-835b-5f9d682f58a1 service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-vif-unplugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-431e6a01-4f0a-4d59-bbcf-69f483391aec req-fad21379-6ea1-476e-835b-5f9d682f58a1 service nova] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-431e6a01-4f0a-4d59-bbcf-69f483391aec req-fad21379-6ea1-476e-835b-5f9d682f58a1 service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-431e6a01-4f0a-4d59-bbcf-69f483391aec req-fad21379-6ea1-476e-835b-5f9d682f58a1 service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-431e6a01-4f0a-4d59-bbcf-69f483391aec req-fad21379-6ea1-476e-835b-5f9d682f58a1 service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] No waiting events found dispatching network-vif-unplugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-431e6a01-4f0a-4d59-bbcf-69f483391aec req-fad21379-6ea1-476e-835b-5f9d682f58a1 service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-vif-unplugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Instance destroyed successfully.
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.objects.instance [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lazy-loading 'resources' on Instance uuid 3c268d22-407c-4ae5-8b05-e7b7ba6046dc {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-586457726',display_name='tempest-AttachVolumeTestJSON-server-586457726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-586457726',id=44,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgANd3VY3VOrcQytu5AFMPpnkTK/XiJT/0w/9tHuzvjIpRxDV60gTZztHNQv4/PdyLzZrWyB7iDiQkwmnKzH06A7dShubZ+1HQBLVmNS4C6JjAclOqp2Plz4JI3zkBeiA==',key_name='tempest-keypair-1255385236',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4088b685db6408fa8b3231fa95405e7',ramdisk_id='',reservation_id='r-n24s7yhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2114655012',owner_user_name='tempest-AttachVolumeTestJSON-2114655012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ce27b8383604c46ab82b2af76c7e26b',uuid=3c268d22-407c-4ae5-8b05-e7b7ba6046dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converting VIF {"id": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "address": "fa:16:3e:df:dd:b1", "network": {"id": "93e2461e-527d-47f8-bd6c-ec7ec9c16479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2095273884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4088b685db6408fa8b3231fa95405e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd59173-10", "ovs_interfaceid": "fbd59173-100b-4fa7-b3cb-6aeafad97145", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:dd:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbd59173-100b-4fa7-b3cb-6aeafad97145,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd59173-10') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG os_vif [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:dd:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbd59173-100b-4fa7-b3cb-6aeafad97145,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd59173-10') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbd59173-10, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:12 user nova-compute[72520]: INFO os_vif [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:dd:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbd59173-100b-4fa7-b3cb-6aeafad97145,network=Network(93e2461e-527d-47f8-bd6c-ec7ec9c16479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd59173-10')
Aug 03 00:10:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Deleting instance files /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc_del
Aug 03 00:10:12 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Deletion of /opt/stack/data/nova/instances/3c268d22-407c-4ae5-8b05-e7b7ba6046dc_del complete
Aug 03 00:10:12 user nova-compute[72520]: INFO nova.compute.manager [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 03 00:10:12 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:10:12 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:10:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:13 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:10:13 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Took 0.82 seconds to deallocate network for instance.
Aug 03 00:10:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:13 user nova-compute[72520]: DEBUG nova.compute.manager [req-379a5d9d-0385-411c-8aad-0fe58bbafb57 req-3f85305d-dde8-4782-9400-4f5ae844597a service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-vif-deleted-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:10:13 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:10:13 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:10:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:14 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Deleted allocations for instance 3c268d22-407c-4ae5-8b05-e7b7ba6046dc
Aug 03 00:10:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-442bdf11-1f22-46a7-bf29-9915cd6b2435 tempest-AttachVolumeTestJSON-2114655012 tempest-AttachVolumeTestJSON-2114655012-project-member] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-f655b415-2475-4f28-84dd-19ed466181fc req-b41f3ac2-fcfc-4877-8052-85ee090de479 service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received event network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f655b415-2475-4f28-84dd-19ed466181fc req-b41f3ac2-fcfc-4877-8052-85ee090de479 service nova] Acquiring lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f655b415-2475-4f28-84dd-19ed466181fc req-b41f3ac2-fcfc-4877-8052-85ee090de479 service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f655b415-2475-4f28-84dd-19ed466181fc req-b41f3ac2-fcfc-4877-8052-85ee090de479 service nova] Lock "3c268d22-407c-4ae5-8b05-e7b7ba6046dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-f655b415-2475-4f28-84dd-19ed466181fc req-b41f3ac2-fcfc-4877-8052-85ee090de479 service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] No waiting events found dispatching network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:10:14 user nova-compute[72520]: WARNING nova.compute.manager [req-f655b415-2475-4f28-84dd-19ed466181fc req-b41f3ac2-fcfc-4877-8052-85ee090de479 service nova] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Received unexpected event network-vif-plugged-fbd59173-100b-4fa7-b3cb-6aeafad97145 for instance with vm_state deleted and task_state None.
Aug 03 00:10:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:10:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:10:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:10:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8342MB free_disk=25.226421356201172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 9bc042e2-58cd-482c-aa12-4fdec288a136 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0aadd692-2737-498e-8b26-ccec1278cadb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:10:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:10:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:10:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:10:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:27 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021412.8414433, 3c268d22-407c-4ae5-8b05-e7b7ba6046dc => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:10:27 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] VM Stopped (Lifecycle Event)
Aug 03 00:10:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b69538bf-407e-4087-9138-65ab22a89376 None None] [instance: 3c268d22-407c-4ae5-8b05-e7b7ba6046dc] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:10:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:10:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:10:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:10:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:10:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:10:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:00 user nova-compute[72520]: INFO nova.compute.manager [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Terminating instance
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-f27f2fb5-775f-4005-9b0c-9d9ec84aa7cb req-6b0bcee3-fe72-4a62-8a4f-4a3d7b872c64 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-unplugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f27f2fb5-775f-4005-9b0c-9d9ec84aa7cb req-6b0bcee3-fe72-4a62-8a4f-4a3d7b872c64 service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f27f2fb5-775f-4005-9b0c-9d9ec84aa7cb req-6b0bcee3-fe72-4a62-8a4f-4a3d7b872c64 service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f27f2fb5-775f-4005-9b0c-9d9ec84aa7cb req-6b0bcee3-fe72-4a62-8a4f-4a3d7b872c64 service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-f27f2fb5-775f-4005-9b0c-9d9ec84aa7cb req-6b0bcee3-fe72-4a62-8a4f-4a3d7b872c64 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-unplugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.compute.manager [req-f27f2fb5-775f-4005-9b0c-9d9ec84aa7cb req-6b0bcee3-fe72-4a62-8a4f-4a3d7b872c64 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-unplugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Instance destroyed successfully.
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lazy-loading 'resources' on Instance uuid 9bc042e2-58cd-482c-aa12-4fdec288a136 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-129161393',display_name='tempest-VolumesActionsTest-instance-129161393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-129161393',id=45,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:09:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7333ffb679d840c99536aedc36be1232',ramdisk_id='',reservation_id='r-cq9dp5b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1919342088',owner_user_name='tempest-VolumesActionsTest-1919342088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:09:16Z,user_data=None,user_id='12b66cf710fd4f70a7c9b722345a1c10',uuid=9bc042e2-58cd-482c-aa12-4fdec288a136,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converting VIF {"id": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "address": "fa:16:3e:34:84:7d", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0744dbb5-bc", "ovs_interfaceid": "0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:7d,bridge_name='br-int',has_traffic_filtering=True,id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0744dbb5-bc') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG os_vif [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:7d,bridge_name='br-int',has_traffic_filtering=True,id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0744dbb5-bc') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0744dbb5-bc, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:11:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:01 user nova-compute[72520]: INFO os_vif [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:84:7d,bridge_name='br-int',has_traffic_filtering=True,id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0744dbb5-bc')
Aug 03 00:11:01 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Deleting instance files /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136_del
Aug 03 00:11:01 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Deletion of /opt/stack/data/nova/instances/9bc042e2-58cd-482c-aa12-4fdec288a136_del complete
Aug 03 00:11:01 user nova-compute[72520]: INFO nova.compute.manager [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 03 00:11:01 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:01 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Took 0.79 seconds to deallocate network for instance.
Aug 03 00:11:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-fd9e47e4-8950-407f-bf1e-c9cec952fa30 req-b0ce3f22-44d3-45eb-9913-2615cfd11fb7 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-deleted-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:01 user nova-compute[72520]: INFO nova.compute.manager [req-fd9e47e4-8950-407f-bf1e-c9cec952fa30 req-b0ce3f22-44d3-45eb-9913-2615cfd11fb7 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Neutron deleted interface 0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14; detaching it from the instance and deleting it from the info cache
Aug 03 00:11:01 user nova-compute[72520]: DEBUG nova.network.neutron [req-fd9e47e4-8950-407f-bf1e-c9cec952fa30 req-b0ce3f22-44d3-45eb-9913-2615cfd11fb7 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-fd9e47e4-8950-407f-bf1e-c9cec952fa30 req-b0ce3f22-44d3-45eb-9913-2615cfd11fb7 service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Detach interface failed, port_id=0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14, reason: Instance 9bc042e2-58cd-482c-aa12-4fdec288a136 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:02 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Deleted allocations for instance 9bc042e2-58cd-482c-aa12-4fdec288a136
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-1f8852b8-96a9-42d2-922f-238e6e75e82d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:02 user nova-compute[72520]: WARNING nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received unexpected event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with vm_state deleted and task_state None.
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:02 user nova-compute[72520]: WARNING nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received unexpected event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with vm_state deleted and task_state None.
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:02 user nova-compute[72520]: WARNING nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received unexpected event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with vm_state deleted and task_state None.
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-unplugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-unplugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:02 user nova-compute[72520]: WARNING nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received unexpected event network-vif-unplugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with vm_state deleted and task_state None.
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Acquiring lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] Lock "9bc042e2-58cd-482c-aa12-4fdec288a136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] No waiting events found dispatching network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:02 user nova-compute[72520]: WARNING nova.compute.manager [req-64dcfa53-1a24-4787-90b0-a40cd049c84d req-2aea21c3-c871-4980-b242-84e105eb8dee service nova] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Received unexpected event network-vif-plugged-0744dbb5-bc3f-466d-bc6b-d3c9c53cfd14 for instance with vm_state deleted and task_state None.
Aug 03 00:11:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-changed-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:03 user nova-compute[72520]: DEBUG nova.compute.manager [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Refreshing instance network info cache due to event network-changed-1fe7b63e-919b-4b9e-af08-505d4e7db0f3. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:11:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] Acquiring lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:11:03 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] Acquired lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:11:03 user nova-compute[72520]: DEBUG nova.network.neutron [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Refreshing network info cache for port 1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG nova.network.neutron [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Updated VIF entry in instance network info cache for port 1fe7b63e-919b-4b9e-af08-505d4e7db0f3. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG nova.network.neutron [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Updating instance_info_cache with network_info: [{"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ed4d9bbd-aae7-4f60-94ce-50220400362e req-c3ef9914-41b5-43d2-b7bd-fe87b92e5605 service nova] Releasing lock "refresh_cache-0aadd692-2737-498e-8b26-ccec1278cadb" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "0aadd692-2737-498e-8b26-ccec1278cadb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "0aadd692-2737-498e-8b26-ccec1278cadb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:04 user nova-compute[72520]: INFO nova.compute.manager [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Terminating instance
Aug 03 00:11:04 user nova-compute[72520]: DEBUG nova.compute.manager [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:11:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-511eceef-1c32-4014-a218-b49a15ad2a40 req-5f6a8555-add4-4122-b4b8-45968638167c service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-vif-unplugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-511eceef-1c32-4014-a218-b49a15ad2a40 req-5f6a8555-add4-4122-b4b8-45968638167c service nova] Acquiring lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-511eceef-1c32-4014-a218-b49a15ad2a40 req-5f6a8555-add4-4122-b4b8-45968638167c service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-511eceef-1c32-4014-a218-b49a15ad2a40 req-5f6a8555-add4-4122-b4b8-45968638167c service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-511eceef-1c32-4014-a218-b49a15ad2a40 req-5f6a8555-add4-4122-b4b8-45968638167c service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] No waiting events found dispatching network-vif-unplugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.compute.manager [req-511eceef-1c32-4014-a218-b49a15ad2a40 req-5f6a8555-add4-4122-b4b8-45968638167c service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-vif-unplugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:11:05 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Instance destroyed successfully.
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.objects.instance [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'resources' on Instance uuid 0aadd692-2737-498e-8b26-ccec1278cadb {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-273945765',display_name='tempest-TestVolumeBootPattern-server-273945765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-273945765',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-y0dbjr5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:09:25Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=0aadd692-2737-498e-8b26-ccec1278cadb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "address": "fa:16:3e:4b:97:3c", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe7b63e-91", "ovs_interfaceid": "1fe7b63e-919b-4b9e-af08-505d4e7db0f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:97:3c,bridge_name='br-int',has_traffic_filtering=True,id=1fe7b63e-919b-4b9e-af08-505d4e7db0f3,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe7b63e-91') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_vif [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:97:3c,bridge_name='br-int',has_traffic_filtering=True,id=1fe7b63e-919b-4b9e-af08-505d4e7db0f3,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe7b63e-91') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fe7b63e-91, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:05 user nova-compute[72520]: INFO os_vif [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:97:3c,bridge_name='br-int',has_traffic_filtering=True,id=1fe7b63e-919b-4b9e-af08-505d4e7db0f3,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe7b63e-91')
Aug 03 00:11:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:11:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7efcd16-c02e-40ee-860c-028671f6eb2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca08ed6-4f2f-4a9a-a622-108168787491]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:11:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:11:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cc46640d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd13fb2-800f-4889-aa8f-2a3bcda124f3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbbfa9c-fb71-49a2-99b8-c9a8d595d58b]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8060b5-d460-429b-9ec8-a31aa9dadf52]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3c04b7-e12a-4237-a2d2-54d49e198ea7]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_30dd9d3e', '/dev/disk/by-id/scsi-1SCST_BIO30dd9d3e-2e4e43c1a5eca50c', '/dev/disk/by-id/scsi-23265346534336331') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8641dc-6b0a-4424-a1d1-c7d1ae64821c]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c4b97-50c2-4ed8-8a0f-3994b1355231]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:11:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9b7e3-a695-4fb5-8576-e227888560a9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]
Aug 03 00:11:06 user nova-compute[72520]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.
Aug 03 00:11:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b12e697-7e5f-4dd3-a52a-7ca8283102b6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== disconnect_volume: return (287ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:11:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Deleting instance files /opt/stack/data/nova/instances/0aadd692-2737-498e-8b26-ccec1278cadb_del
Aug 03 00:11:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Deletion of /opt/stack/data/nova/instances/0aadd692-2737-498e-8b26-ccec1278cadb_del complete
Aug 03 00:11:06 user nova-compute[72520]: INFO nova.compute.manager [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 03 00:11:06 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:11:06 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:06 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Took 0.76 seconds to deallocate network for instance.
Aug 03 00:11:06 user nova-compute[72520]: DEBUG nova.compute.manager [req-40384e12-f21c-4174-b6c4-12060647f6d7 req-3a3f940e-3e60-4fec-94f0-31fc9e799c81 service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-vif-deleted-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-449a495b-77aa-466f-84ee-f1ab40e0f3f5 req-c233046b-dbd5-43ba-8b98-2d227ed01bae service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received event network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-449a495b-77aa-466f-84ee-f1ab40e0f3f5 req-c233046b-dbd5-43ba-8b98-2d227ed01bae service nova] Acquiring lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-449a495b-77aa-466f-84ee-f1ab40e0f3f5 req-c233046b-dbd5-43ba-8b98-2d227ed01bae service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-449a495b-77aa-466f-84ee-f1ab40e0f3f5 req-c233046b-dbd5-43ba-8b98-2d227ed01bae service nova] Lock "0aadd692-2737-498e-8b26-ccec1278cadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG nova.compute.manager [req-449a495b-77aa-466f-84ee-f1ab40e0f3f5 req-c233046b-dbd5-43ba-8b98-2d227ed01bae service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] No waiting events found dispatching network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:07 user nova-compute[72520]: WARNING nova.compute.manager [req-449a495b-77aa-466f-84ee-f1ab40e0f3f5 req-c233046b-dbd5-43ba-8b98-2d227ed01bae service nova] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Received unexpected event network-vif-plugged-1fe7b63e-919b-4b9e-af08-505d4e7db0f3 for instance with vm_state active and task_state deleting.
Aug 03 00:11:07 user nova-compute[72520]: INFO nova.compute.manager [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Took 0.72 seconds to detach 1 volumes for instance.
Aug 03 00:11:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:11:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:07 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Deleted allocations for instance 0aadd692-2737-498e-8b26-ccec1278cadb
Aug 03 00:11:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4c348d26-d6e5-44aa-8188-717ddc591de4 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "0aadd692-2737-498e-8b26-ccec1278cadb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.113s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:15 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021460.9553466, 9bc042e2-58cd-482c-aa12-4fdec288a136 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:11:15 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] VM Stopped (Lifecycle Event)
Aug 03 00:11:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-e18d696b-b3ee-4c4e-a624-886000d0e38b None None] [instance: 9bc042e2-58cd-482c-aa12-4fdec288a136] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:11:16 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:17 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:11:18 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:11:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.25273895263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:11:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:20 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021465.7216456, 0aadd692-2737-498e-8b26-ccec1278cadb => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:11:20 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] VM Stopped (Lifecycle Event)
Aug 03 00:11:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-52d45035-e964-4f0c-854f-eb22ce0f5c27 None None] [instance: 0aadd692-2737-498e-8b26-ccec1278cadb] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:11:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:11:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:11:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:11:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:11:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:11:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:11:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:11:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:11:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:11:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:11:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:11:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:11:52 user nova-compute[72520]: INFO nova.compute.claims [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Claim successful on node user
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:11:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.policy [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12b66cf710fd4f70a7c9b722345a1c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7333ffb679d840c99536aedc36be1232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:11:52 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Creating image(s)
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "/opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "/opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "/opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:52 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.151s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk 1073741824" returned: 0 in 0.051s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.156s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Cannot resize image /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lazy-loading 'migration_context' on Instance uuid 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Successfully created port: 0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Ensure instance console log exists: /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Successfully updated port: 0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquired lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received event network-changed-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Refreshing instance network info cache due to event network-changed-0b48de4b-80da-41e9-b555-68c99cce1d5a. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] Acquiring lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.neutron [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Updating instance_info_cache with network_info: [{"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Releasing lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Instance network_info: |[{"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] Acquired lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.neutron [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Refreshing network info cache for port 0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Start _get_guest_xml network_info=[{"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:11:54 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:11:54 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1682269300',display_name='tempest-VolumesActionsTest-instance-1682269300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1682269300',id=47,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7333ffb679d840c99536aedc36be1232',ramdisk_id='',reservation_id='r-ru9380v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1919342088',owner_user_name='tempest-VolumesActionsTest-1919342088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:11:53Z,user_data=None,user_id='12b66cf710fd4f70a7c9b722345a1c10',uuid=044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converting VIF {"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:bc,bridge_name='br-int',has_traffic_filtering=True,id=0b48de4b-80da-41e9-b555-68c99cce1d5a,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48de4b-80') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.objects.instance [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lazy-loading 'pci_devices' on Instance uuid 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:11:54 user nova-compute[72520]:   <uuid>044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0</uuid>
Aug 03 00:11:54 user nova-compute[72520]:   <name>instance-0000002f</name>
Aug 03 00:11:54 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:11:54 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:11:54 user nova-compute[72520]:   <metadata>
Aug 03 00:11:54 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:11:54 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:11:54 user nova-compute[72520]:       <nova:name>tempest-VolumesActionsTest-instance-1682269300</nova:name>
Aug 03 00:11:54 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:11:54</nova:creationTime>
Aug 03 00:11:54 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:11:54 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:11:54 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:11:54 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:11:54 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:11:54 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:11:54 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:11:54 user nova-compute[72520]:       <nova:owner>
Aug 03 00:11:54 user nova-compute[72520]:         <nova:user uuid="12b66cf710fd4f70a7c9b722345a1c10">tempest-VolumesActionsTest-1919342088-project-member</nova:user>
Aug 03 00:11:54 user nova-compute[72520]:         <nova:project uuid="7333ffb679d840c99536aedc36be1232">tempest-VolumesActionsTest-1919342088</nova:project>
Aug 03 00:11:54 user nova-compute[72520]:       </nova:owner>
Aug 03 00:11:54 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:11:54 user nova-compute[72520]:       <nova:ports>
Aug 03 00:11:54 user nova-compute[72520]:         <nova:port uuid="0b48de4b-80da-41e9-b555-68c99cce1d5a">
Aug 03 00:11:54 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 03 00:11:54 user nova-compute[72520]:         </nova:port>
Aug 03 00:11:54 user nova-compute[72520]:       </nova:ports>
Aug 03 00:11:54 user nova-compute[72520]:     </nova:instance>
Aug 03 00:11:54 user nova-compute[72520]:   </metadata>
Aug 03 00:11:54 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:11:54 user nova-compute[72520]:     <system>
Aug 03 00:11:54 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:11:54 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:11:54 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:11:54 user nova-compute[72520]:       <entry name="serial">044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0</entry>
Aug 03 00:11:54 user nova-compute[72520]:       <entry name="uuid">044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0</entry>
Aug 03 00:11:54 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:11:54 user nova-compute[72520]:     </system>
Aug 03 00:11:54 user nova-compute[72520]:   </sysinfo>
Aug 03 00:11:54 user nova-compute[72520]:   <os>
Aug 03 00:11:54 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:11:54 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:11:54 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:11:54 user nova-compute[72520]:   </os>
Aug 03 00:11:54 user nova-compute[72520]:   <features>
Aug 03 00:11:54 user nova-compute[72520]:     <acpi/>
Aug 03 00:11:54 user nova-compute[72520]:     <apic/>
Aug 03 00:11:54 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:11:54 user nova-compute[72520]:   </features>
Aug 03 00:11:54 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:11:54 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:11:54 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:11:54 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:11:54 user nova-compute[72520]:   </clock>
Aug 03 00:11:54 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:11:54 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:11:54 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:11:54 user nova-compute[72520]:   </cpu>
Aug 03 00:11:54 user nova-compute[72520]:   <devices>
Aug 03 00:11:54 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:11:54 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:11:54 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk"/>
Aug 03 00:11:54 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:11:54 user nova-compute[72520]:     </disk>
Aug 03 00:11:54 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:11:54 user nova-compute[72520]:       <mac address="fa:16:3e:dc:42:bc"/>
Aug 03 00:11:54 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:11:54 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:11:54 user nova-compute[72520]:       <target dev="tap0b48de4b-80"/>
Aug 03 00:11:54 user nova-compute[72520]:     </interface>
Aug 03 00:11:54 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:11:54 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/console.log" append="off"/>
Aug 03 00:11:54 user nova-compute[72520]:     </serial>
Aug 03 00:11:54 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:11:54 user nova-compute[72520]:     <video>
Aug 03 00:11:54 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:11:54 user nova-compute[72520]:     </video>
Aug 03 00:11:54 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:11:54 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:11:54 user nova-compute[72520]:     </rng>
Aug 03 00:11:54 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:11:54 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:11:54 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:11:54 user nova-compute[72520]:     </memballoon>
Aug 03 00:11:54 user nova-compute[72520]:   </devices>
Aug 03 00:11:54 user nova-compute[72520]: </domain>
Aug 03 00:11:54 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1682269300',display_name='tempest-VolumesActionsTest-instance-1682269300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1682269300',id=47,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7333ffb679d840c99536aedc36be1232',ramdisk_id='',reservation_id='r-ru9380v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1919342088',owner_user_name='tempest-VolumesActionsTest-1919342088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:11:53Z,user_data=None,user_id='12b66cf710fd4f70a7c9b722345a1c10',uuid=044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converting VIF {"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:bc,bridge_name='br-int',has_traffic_filtering=True,id=0b48de4b-80da-41e9-b555-68c99cce1d5a,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48de4b-80') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG os_vif [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:bc,bridge_name='br-int',has_traffic_filtering=True,id=0b48de4b-80da-41e9-b555-68c99cce1d5a,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48de4b-80') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b48de4b-80, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b48de4b-80, col_values=(('external_ids', {'iface-id': '0b48de4b-80da-41e9-b555-68c99cce1d5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:42:bc', 'vm-uuid': '044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:54 user nova-compute[72520]: INFO os_vif [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:bc,bridge_name='br-int',has_traffic_filtering=True,id=0b48de4b-80da-41e9-b555-68c99cce1d5a,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48de4b-80')
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:11:54 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] No VIF found with MAC fa:16:3e:dc:42:bc, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:11:55 user nova-compute[72520]: DEBUG nova.network.neutron [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Updated VIF entry in instance network info cache for port 0b48de4b-80da-41e9-b555-68c99cce1d5a. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:11:55 user nova-compute[72520]: DEBUG nova.network.neutron [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Updating instance_info_cache with network_info: [{"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-8761acf5-8442-453a-9fdc-51975db3ff8c req-0a3f4fd3-da37-4a64-a202-9e59de16603b service nova] Releasing lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-b8e44fd7-e986-4c99-8a17-fd2936b2a6d2 req-cca0dc8f-ad59-4783-a7d3-0f4952bf0cab service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received event network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8e44fd7-e986-4c99-8a17-fd2936b2a6d2 req-cca0dc8f-ad59-4783-a7d3-0f4952bf0cab service nova] Acquiring lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8e44fd7-e986-4c99-8a17-fd2936b2a6d2 req-cca0dc8f-ad59-4783-a7d3-0f4952bf0cab service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b8e44fd7-e986-4c99-8a17-fd2936b2a6d2 req-cca0dc8f-ad59-4783-a7d3-0f4952bf0cab service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG nova.compute.manager [req-b8e44fd7-e986-4c99-8a17-fd2936b2a6d2 req-cca0dc8f-ad59-4783-a7d3-0f4952bf0cab service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] No waiting events found dispatching network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:56 user nova-compute[72520]: WARNING nova.compute.manager [req-b8e44fd7-e986-4c99-8a17-fd2936b2a6d2 req-cca0dc8f-ad59-4783-a7d3-0f4952bf0cab service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received unexpected event network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a for instance with vm_state building and task_state spawning.
Aug 03 00:11:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "d5536440-4428-4947-9230-1dda93617841" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "d5536440-4428-4947-9230-1dda93617841" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:11:56 user nova-compute[72520]: INFO nova.compute.claims [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Claim successful on node user
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:11:56 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:11:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:11:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG nova.policy [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f4f73d9df5413590eb77ae2b94090d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a710f41a5a44408a041238b388d588e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:11:57 user nova-compute[72520]: INFO nova.virt.block_device [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Booting with volume c91a3508-a173-4bd6-8a65-1b27dc45b8c7 at /dev/vda
Aug 03 00:11:57 user nova-compute[72520]: DEBUG os_brick.utils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0700eb6-a7e6-4d6d-b194-394d19d645c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb99c20-8822-4ff4-987f-99bf0f735fd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ea5f79-0654-47a9-94b0-a338124ee108]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db7e26-81f9-43e9-a5e3-acc8cd240fcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:11:57 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:11:57 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a1e786-4ad5-41ee-b34a-3c188a0c6a28]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG os_brick.utils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Updating existing volume attachment record: 2fad61f9-5471-45f1-b88a-181c641cfeee {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:11:57 user nova-compute[72520]: DEBUG nova.network.neutron [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Successfully created port: 728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-5a348fd1-de4c-4218-91f0-4a5b491bf4f3 req-69065208-5c90-4c91-bf2e-2e42af430525 service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received event network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a348fd1-de4c-4218-91f0-4a5b491bf4f3 req-69065208-5c90-4c91-bf2e-2e42af430525 service nova] Acquiring lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a348fd1-de4c-4218-91f0-4a5b491bf4f3 req-69065208-5c90-4c91-bf2e-2e42af430525 service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5a348fd1-de4c-4218-91f0-4a5b491bf4f3 req-69065208-5c90-4c91-bf2e-2e42af430525 service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-5a348fd1-de4c-4218-91f0-4a5b491bf4f3 req-69065208-5c90-4c91-bf2e-2e42af430525 service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] No waiting events found dispatching network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:11:58 user nova-compute[72520]: WARNING nova.compute.manager [req-5a348fd1-de4c-4218-91f0-4a5b491bf4f3 req-69065208-5c90-4c91-bf2e-2e42af430525 service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received unexpected event network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a for instance with vm_state building and task_state spawning.
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021518.7354271, 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:11:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] VM Resumed (Lifecycle Event)
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:11:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Instance spawned successfully.
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:11:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021518.7410536, 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:11:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] VM Started (Lifecycle Event)
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:11:58 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:11:58 user nova-compute[72520]: INFO nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Successfully updated port: 728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquired lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-changed-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.compute.manager [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Refreshing instance network info cache due to event network-changed-728d8ed4-9435-4179-99c2-77bab6d908ed. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] Acquiring lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:11:58 user nova-compute[72520]: INFO nova.compute.manager [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Took 6.80 seconds to build instance.
Aug 03 00:11:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:11:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-ec41a510-672c-4919-8a8c-29f87c022c63 tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.948s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Updating instance_info_cache with network_info: [{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Releasing lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Instance network_info: |[{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] Acquired lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Refreshing network info cache for port 728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Updated VIF entry in instance network info cache for port 728d8ed4-9435-4179-99c2-77bab6d908ed. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG nova.network.neutron [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Updating instance_info_cache with network_info: [{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-5c2ca9c9-2964-47a2-8737-2e5e24c4178a req-1c5644b3-d02e-4e7f-9194-33753bacdca1 service nova] Releasing lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:11:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:12:05 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Creating image(s)
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Ensure instance console log exists: /opt/stack/data/nova/instances/d5536440-4428-4947-9230-1dda93617841/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Start _get_guest_xml network_info=[{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5536440-4428-4947-9230-1dda93617841', 'attached_at': '', 'detached_at': '', 'volume_id': 'c91a3508-a173-4bd6-8a65-1b27dc45b8c7', 'serial': 'c91a3508-a173-4bd6-8a65-1b27dc45b8c7'}, 'attachment_id': '2fad61f9-5471-45f1-b88a-181c641cfeee', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:12:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:12:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:12:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:12:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:12:05 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6ed167-f0aa-4d4d-88b1-2b53c3cfcdbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:12:05 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a30cf46-183f-4f95-b5c6-39106d3f5f5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7] added
Aug 03 00:12:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13da8c9a-31b3-44b2-9758-cd92440ee5d2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec108c54-b1ca-483a-8426-b62d651d41dc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJVHPCXB {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJVHPCXB" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbfbcc8-f153-46df-a5ee-d6f1c8fb102e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJVHPCXB'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f60ac7-0806-4674-8060-9c1dd11e81e1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c376e-6dd8-40d2-afb6-ccae0eeec91a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:12:05 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:12:05 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:12:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:12:05 user nova-compute[72520]: 
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbff8e9-9980-4dd5-a74f-6e2e63ef0f40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]
Aug 03 00:12:05 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.
Aug 03 00:12:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[683f909d-a976-4945-8243-c2357c78eb46]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4132a9-88a4-4b2c-b06d-bac87d27b692]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:12:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:12:05 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab25a55-3b91-416d-a807-a333b4d7d299]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:12:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23265346534336331', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265346534336331', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1488271112',display_name='tempest-TestVolumeBootPattern-server-1488271112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1488271112',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-csnx7kp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:11:57Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=d5536440-4428-4947-9230-1dda93617841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c6:61,bridge_name='br-int',has_traffic_filtering=True,id=728d8ed4-9435-4179-99c2-77bab6d908ed,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d8ed4-94') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.objects.instance [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'pci_devices' on Instance uuid d5536440-4428-4947-9230-1dda93617841 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:12:06 user nova-compute[72520]:   <uuid>d5536440-4428-4947-9230-1dda93617841</uuid>
Aug 03 00:12:06 user nova-compute[72520]:   <name>instance-00000030</name>
Aug 03 00:12:06 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:12:06 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:12:06 user nova-compute[72520]:   <metadata>
Aug 03 00:12:06 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:12:06 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:12:06 user nova-compute[72520]:       <nova:name>tempest-TestVolumeBootPattern-server-1488271112</nova:name>
Aug 03 00:12:06 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:12:05</nova:creationTime>
Aug 03 00:12:06 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:12:06 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:12:06 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:12:06 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:12:06 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:12:06 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:12:06 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:12:06 user nova-compute[72520]:       <nova:owner>
Aug 03 00:12:06 user nova-compute[72520]:         <nova:user uuid="53f4f73d9df5413590eb77ae2b94090d">tempest-TestVolumeBootPattern-1675749395-project-member</nova:user>
Aug 03 00:12:06 user nova-compute[72520]:         <nova:project uuid="4a710f41a5a44408a041238b388d588e">tempest-TestVolumeBootPattern-1675749395</nova:project>
Aug 03 00:12:06 user nova-compute[72520]:       </nova:owner>
Aug 03 00:12:06 user nova-compute[72520]:       <nova:ports>
Aug 03 00:12:06 user nova-compute[72520]:         <nova:port uuid="728d8ed4-9435-4179-99c2-77bab6d908ed">
Aug 03 00:12:06 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 00:12:06 user nova-compute[72520]:         </nova:port>
Aug 03 00:12:06 user nova-compute[72520]:       </nova:ports>
Aug 03 00:12:06 user nova-compute[72520]:     </nova:instance>
Aug 03 00:12:06 user nova-compute[72520]:   </metadata>
Aug 03 00:12:06 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:12:06 user nova-compute[72520]:     <system>
Aug 03 00:12:06 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:12:06 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:12:06 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:12:06 user nova-compute[72520]:       <entry name="serial">d5536440-4428-4947-9230-1dda93617841</entry>
Aug 03 00:12:06 user nova-compute[72520]:       <entry name="uuid">d5536440-4428-4947-9230-1dda93617841</entry>
Aug 03 00:12:06 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:12:06 user nova-compute[72520]:     </system>
Aug 03 00:12:06 user nova-compute[72520]:   </sysinfo>
Aug 03 00:12:06 user nova-compute[72520]:   <os>
Aug 03 00:12:06 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:12:06 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:12:06 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:12:06 user nova-compute[72520]:   </os>
Aug 03 00:12:06 user nova-compute[72520]:   <features>
Aug 03 00:12:06 user nova-compute[72520]:     <acpi/>
Aug 03 00:12:06 user nova-compute[72520]:     <apic/>
Aug 03 00:12:06 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:12:06 user nova-compute[72520]:   </features>
Aug 03 00:12:06 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:12:06 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:12:06 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:12:06 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:12:06 user nova-compute[72520]:   </clock>
Aug 03 00:12:06 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:12:06 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:12:06 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:12:06 user nova-compute[72520]:   </cpu>
Aug 03 00:12:06 user nova-compute[72520]:   <devices>
Aug 03 00:12:06 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:12:06 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:12:06 user nova-compute[72520]:       <source dev="/dev/sdb"/>
Aug 03 00:12:06 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:12:06 user nova-compute[72520]:       <serial>c91a3508-a173-4bd6-8a65-1b27dc45b8c7</serial>
Aug 03 00:12:06 user nova-compute[72520]:     </disk>
Aug 03 00:12:06 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:12:06 user nova-compute[72520]:       <mac address="fa:16:3e:04:c6:61"/>
Aug 03 00:12:06 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:12:06 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:12:06 user nova-compute[72520]:       <target dev="tap728d8ed4-94"/>
Aug 03 00:12:06 user nova-compute[72520]:     </interface>
Aug 03 00:12:06 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:12:06 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/d5536440-4428-4947-9230-1dda93617841/console.log" append="off"/>
Aug 03 00:12:06 user nova-compute[72520]:     </serial>
Aug 03 00:12:06 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:12:06 user nova-compute[72520]:     <video>
Aug 03 00:12:06 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:12:06 user nova-compute[72520]:     </video>
Aug 03 00:12:06 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:12:06 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:12:06 user nova-compute[72520]:     </rng>
Aug 03 00:12:06 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:12:06 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:12:06 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:12:06 user nova-compute[72520]:     </memballoon>
Aug 03 00:12:06 user nova-compute[72520]:   </devices>
Aug 03 00:12:06 user nova-compute[72520]: </domain>
Aug 03 00:12:06 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1488271112',display_name='tempest-TestVolumeBootPattern-server-1488271112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1488271112',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-csnx7kp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:11:57Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=d5536440-4428-4947-9230-1dda93617841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c6:61,bridge_name='br-int',has_traffic_filtering=True,id=728d8ed4-9435-4179-99c2-77bab6d908ed,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d8ed4-94') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG os_vif [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c6:61,bridge_name='br-int',has_traffic_filtering=True,id=728d8ed4-9435-4179-99c2-77bab6d908ed,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d8ed4-94') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap728d8ed4-94, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap728d8ed4-94, col_values=(('external_ids', {'iface-id': '728d8ed4-9435-4179-99c2-77bab6d908ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:c6:61', 'vm-uuid': 'd5536440-4428-4947-9230-1dda93617841'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:06 user nova-compute[72520]: INFO os_vif [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c6:61,bridge_name='br-int',has_traffic_filtering=True,id=728d8ed4-9435-4179-99c2-77bab6d908ed,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d8ed4-94')
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:12:06 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No VIF found with MAC fa:16:3e:04:c6:61, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:12:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-168b6237-0bc2-4bd1-9bdb-1c2ec84d035a req-b05f978f-4b3f-4046-b516-3409e6fb0719 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-168b6237-0bc2-4bd1-9bdb-1c2ec84d035a req-b05f978f-4b3f-4046-b516-3409e6fb0719 service nova] Acquiring lock "d5536440-4428-4947-9230-1dda93617841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-168b6237-0bc2-4bd1-9bdb-1c2ec84d035a req-b05f978f-4b3f-4046-b516-3409e6fb0719 service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-168b6237-0bc2-4bd1-9bdb-1c2ec84d035a req-b05f978f-4b3f-4046-b516-3409e6fb0719 service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-168b6237-0bc2-4bd1-9bdb-1c2ec84d035a req-b05f978f-4b3f-4046-b516-3409e6fb0719 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] No waiting events found dispatching network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:12:09 user nova-compute[72520]: WARNING nova.compute.manager [req-168b6237-0bc2-4bd1-9bdb-1c2ec84d035a req-b05f978f-4b3f-4046-b516-3409e6fb0719 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received unexpected event network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed for instance with vm_state building and task_state spawning.
Aug 03 00:12:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021530.59323, d5536440-4428-4947-9230-1dda93617841 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:12:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] VM Resumed (Lifecycle Event)
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:12:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: d5536440-4428-4947-9230-1dda93617841] Instance spawned successfully.
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:12:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021530.5945663, d5536440-4428-4947-9230-1dda93617841 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:12:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] VM Started (Lifecycle Event)
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:12:10 user nova-compute[72520]: INFO nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:12:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:12:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: d5536440-4428-4947-9230-1dda93617841] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:12:10 user nova-compute[72520]: INFO nova.compute.manager [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Took 14.10 seconds to build instance.
Aug 03 00:12:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-7e10d8b3-ce5c-4887-a7a6-a5b9aa3cf370 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "d5536440-4428-4947-9230-1dda93617841" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.230s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:12:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-f583067f-4d7b-470b-b097-435820e5d548 req-de76ad5a-296a-4952-a0f2-f3b9824cd2ed service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:12:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f583067f-4d7b-470b-b097-435820e5d548 req-de76ad5a-296a-4952-a0f2-f3b9824cd2ed service nova] Acquiring lock "d5536440-4428-4947-9230-1dda93617841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:12:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f583067f-4d7b-470b-b097-435820e5d548 req-de76ad5a-296a-4952-a0f2-f3b9824cd2ed service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:12:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-f583067f-4d7b-470b-b097-435820e5d548 req-de76ad5a-296a-4952-a0f2-f3b9824cd2ed service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:12:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-f583067f-4d7b-470b-b097-435820e5d548 req-de76ad5a-296a-4952-a0f2-f3b9824cd2ed service nova] [instance: d5536440-4428-4947-9230-1dda93617841] No waiting events found dispatching network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:12:11 user nova-compute[72520]: WARNING nova.compute.manager [req-f583067f-4d7b-470b-b097-435820e5d548 req-de76ad5a-296a-4952-a0f2-f3b9824cd2ed service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received unexpected event network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed for instance with vm_state active and task_state None.
Aug 03 00:12:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:13 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 00:12:14 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:12:18 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [{"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:19 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:12:20 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:12:20 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=25.214290618896484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d5536440-4428-4947-9230-1dda93617841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:12:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:12:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:12:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:12:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 00:12:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 00:12:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:12:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:01 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:13:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:13:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:15 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Updating instance_info_cache with network_info: [{"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:13:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:13:19 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:13:21 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:13:22 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:13:22 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=25.210330963134766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d5536440-4428-4947-9230-1dda93617841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 00:13:22 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:13:23 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:13:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:13:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:25 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:13:26 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:13:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:42 user nova-compute[72520]: INFO nova.compute.manager [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Terminating instance
Aug 03 00:13:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-c31b7e82-9807-4fd0-bcbe-d7995fa94cce req-78f135aa-9ff3-4b61-bd70-ea461686ffb7 service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received event network-vif-unplugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c31b7e82-9807-4fd0-bcbe-d7995fa94cce req-78f135aa-9ff3-4b61-bd70-ea461686ffb7 service nova] Acquiring lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c31b7e82-9807-4fd0-bcbe-d7995fa94cce req-78f135aa-9ff3-4b61-bd70-ea461686ffb7 service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c31b7e82-9807-4fd0-bcbe-d7995fa94cce req-78f135aa-9ff3-4b61-bd70-ea461686ffb7 service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-c31b7e82-9807-4fd0-bcbe-d7995fa94cce req-78f135aa-9ff3-4b61-bd70-ea461686ffb7 service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] No waiting events found dispatching network-vif-unplugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:13:42 user nova-compute[72520]: DEBUG nova.compute.manager [req-c31b7e82-9807-4fd0-bcbe-d7995fa94cce req-78f135aa-9ff3-4b61-bd70-ea461686ffb7 service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received event network-vif-unplugged-0b48de4b-80da-41e9-b555-68c99cce1d5a for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Instance destroyed successfully.
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.objects.instance [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lazy-loading 'resources' on Instance uuid 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1682269300',display_name='tempest-VolumesActionsTest-instance-1682269300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1682269300',id=47,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:11:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7333ffb679d840c99536aedc36be1232',ramdisk_id='',reservation_id='r-ru9380v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1919342088',owner_user_name='tempest-VolumesActionsTest-1919342088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:11:59Z,user_data=None,user_id='12b66cf710fd4f70a7c9b722345a1c10',uuid=044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converting VIF {"id": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "address": "fa:16:3e:dc:42:bc", "network": {"id": "b89f379d-e11b-4987-8105-ba7e1d0a4119", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1476568616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7333ffb679d840c99536aedc36be1232", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b48de4b-80", "ovs_interfaceid": "0b48de4b-80da-41e9-b555-68c99cce1d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:42:bc,bridge_name='br-int',has_traffic_filtering=True,id=0b48de4b-80da-41e9-b555-68c99cce1d5a,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48de4b-80') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG os_vif [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:42:bc,bridge_name='br-int',has_traffic_filtering=True,id=0b48de4b-80da-41e9-b555-68c99cce1d5a,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48de4b-80') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b48de4b-80, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:13:43 user nova-compute[72520]: INFO os_vif [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:42:bc,bridge_name='br-int',has_traffic_filtering=True,id=0b48de4b-80da-41e9-b555-68c99cce1d5a,network=Network(b89f379d-e11b-4987-8105-ba7e1d0a4119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b48de4b-80')
Aug 03 00:13:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Deleting instance files /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0_del
Aug 03 00:13:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Deletion of /opt/stack/data/nova/instances/044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0_del complete
Aug 03 00:13:43 user nova-compute[72520]: INFO nova.compute.manager [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 03 00:13:43 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:13:43 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Took 0.48 seconds to deallocate network for instance.
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.compute.manager [req-894d5bc9-ee01-4a22-accb-b422b2ec8fa1 req-94d821e0-3a6b-45f6-98f1-e9ecc6849618 service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received event network-vif-deleted-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:13:43 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:13:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:44 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Deleted allocations for instance 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0
Aug 03 00:13:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-9210a1e0-3ea6-4bbf-a4f0-82b46fe0a54d tempest-VolumesActionsTest-1919342088 tempest-VolumesActionsTest-1919342088-project-member] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.661s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-dba1dfe0-4263-477f-b5ef-28caa686c510 req-b9c232ec-6333-466c-8e9b-8607c73807fd service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received event network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:13:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-dba1dfe0-4263-477f-b5ef-28caa686c510 req-b9c232ec-6333-466c-8e9b-8607c73807fd service nova] Acquiring lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-dba1dfe0-4263-477f-b5ef-28caa686c510 req-b9c232ec-6333-466c-8e9b-8607c73807fd service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-dba1dfe0-4263-477f-b5ef-28caa686c510 req-b9c232ec-6333-466c-8e9b-8607c73807fd service nova] Lock "044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:44 user nova-compute[72520]: DEBUG nova.compute.manager [req-dba1dfe0-4263-477f-b5ef-28caa686c510 req-b9c232ec-6333-466c-8e9b-8607c73807fd service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] No waiting events found dispatching network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:13:44 user nova-compute[72520]: WARNING nova.compute.manager [req-dba1dfe0-4263-477f-b5ef-28caa686c510 req-b9c232ec-6333-466c-8e9b-8607c73807fd service nova] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Received unexpected event network-vif-plugged-0b48de4b-80da-41e9-b555-68c99cce1d5a for instance with vm_state deleted and task_state None.
Aug 03 00:13:48 user nova-compute[72520]: DEBUG nova.compute.manager [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-changed-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG nova.compute.manager [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Refreshing instance network info cache due to event network-changed-728d8ed4-9435-4179-99c2-77bab6d908ed. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] Acquiring lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] Acquired lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG nova.network.neutron [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Refreshing network info cache for port 728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG nova.network.neutron [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Updated VIF entry in instance network info cache for port 728d8ed4-9435-4179-99c2-77bab6d908ed. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG nova.network.neutron [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Updating instance_info_cache with network_info: [{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:13:48 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-875c4436-44f1-46dd-9f94-0bc47d6e5b08 req-f3fadf89-06cf-43cb-b453-bb5e94d3e852 service nova] Releasing lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:13:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:57 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:13:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:13:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:13:57 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:13:57 user nova-compute[72520]: INFO nova.compute.claims [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Claim successful on node user
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:13:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021623.235746, 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:13:58 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] VM Stopped (Lifecycle Event)
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f98284c1-bbe1-49f8-ae85-0eac17a9da4a None None] [instance: 044e3ae5-2c24-4ce3-8c9b-e429d46f7cf0] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:58 user nova-compute[72520]: INFO nova.virt.block_device [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Booting with volume d9cd58eb-d45a-43d8-bda5-e0e35f540fdd at /dev/vda
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.policy [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f4f73d9df5413590eb77ae2b94090d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a710f41a5a44408a041238b388d588e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG os_brick.utils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3063e3-6ed6-4b7b-9d29-e7fa18180a88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd72efa-7cc3-40f9-9544-d359395eee48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b085d-7fd6-4d12-9dd2-b7454a63c1ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeb3967-cd75-4b05-ac20-f2bc48825c08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:13:58 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:13:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14983e56-80bf-49de-99da-7fa25f73ed3d]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG os_brick.utils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updating existing volume attachment record: 176c851b-aaac-4556-894d-1c6ec5e78a03 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:13:58 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Successfully created port: eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Successfully updated port: eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquired lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-changed-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Refreshing instance network info cache due to event network-changed-eeb7940b-417f-41f4-9672-7ac729f71979. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] Acquiring lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:13:59 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updating instance_info_cache with network_info: [{"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:14:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Releasing lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:14:00 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Instance network_info: |[{"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:14:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] Acquired lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:14:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Refreshing network info cache for port eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:14:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updated VIF entry in instance network info cache for port eeb7940b-417f-41f4-9672-7ac729f71979. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:14:00 user nova-compute[72520]: DEBUG nova.network.neutron [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updating instance_info_cache with network_info: [{"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:14:00 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d142b141-9a60-463d-b3be-3ba1dcfff9b5 req-07d81877-12f7-4dc6-b4b0-ab8f42e39511 service nova] Releasing lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:14:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:14:05 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Creating image(s)
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Did not create local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Ensure instance console log exists: /opt/stack/data/nova/instances/4876b7ad-c546-4b5a-aca0-7a9f5aa57101/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Start _get_guest_xml network_info=[{"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHqNPtOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4876b7ad-c546-4b5a-aca0-7a9f5aa57101', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9cd58eb-d45a-43d8-bda5-e0e35f540fdd', 'serial': 'd9cd58eb-d45a-43d8-bda5-e0e35f540fdd'}, 'attachment_id': '176c851b-aaac-4556-894d-1c6ec5e78a03', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:14:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:14:05 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHqNPtOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:14:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:14:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:14:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:14:05 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:14:05 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:14:06 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c0f806-5f47-499a-8a19-d466734a5376]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:14:06 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[917bcc55-6529-43ba-a85a-5f317dde70f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd] added
Aug 03 00:14:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87de7f-664b-46aa-bb73-4e5f13b09159]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c13f343-437f-4b79-a77d-403b0c917b58]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHqNPtOy {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHqNPtOy" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[534cc31c-bd42-4c34-92be-4aa0edd532e4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gHqNPtOy'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[197c8575-ab79-4f17-adb8-447cf0e83437]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4398ecf0-01f9-4588-a247-9ae1e8b577f4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:14:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:14:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7141032-1336-42b5-8dcc-1e0afca8a530]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260]
Aug 03 00:14:06 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260] successful.
Aug 03 00:14:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9d1c9-2496-4d56-a1d6-eba90af06f82]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c9175-1890-43a8-a2e2-aedd6087593e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:14:06 user nova-compute[72520]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd (non-flash)
Aug 03 00:14:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:14:06 user nova-compute[72520]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd (non-flash)
Aug 03 00:14:06 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acfe92b-d13e-4a47-b19c-91355e4c7bd5]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:14:06 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHqNPtOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26537636332663536', 'path': '/dev/sdc'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537636332663536', 'path': '/dev/sdc'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2129243143',display_name='tempest-TestVolumeBootPattern-server-2129243143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2129243143',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-zkyedh70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:13:58Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=4876b7ad-c546-4b5a-aca0-7a9f5aa57101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:08,bridge_name='br-int',has_traffic_filtering=True,id=eeb7940b-417f-41f4-9672-7ac729f71979,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7940b-41') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'pci_devices' on Instance uuid 4876b7ad-c546-4b5a-aca0-7a9f5aa57101 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:14:07 user nova-compute[72520]:   <uuid>4876b7ad-c546-4b5a-aca0-7a9f5aa57101</uuid>
Aug 03 00:14:07 user nova-compute[72520]:   <name>instance-00000031</name>
Aug 03 00:14:07 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:14:07 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:14:07 user nova-compute[72520]:   <metadata>
Aug 03 00:14:07 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:14:07 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:14:07 user nova-compute[72520]:       <nova:name>tempest-TestVolumeBootPattern-server-2129243143</nova:name>
Aug 03 00:14:07 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:14:05</nova:creationTime>
Aug 03 00:14:07 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:14:07 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:14:07 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:14:07 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:14:07 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:14:07 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:14:07 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:14:07 user nova-compute[72520]:       <nova:owner>
Aug 03 00:14:07 user nova-compute[72520]:         <nova:user uuid="53f4f73d9df5413590eb77ae2b94090d">tempest-TestVolumeBootPattern-1675749395-project-member</nova:user>
Aug 03 00:14:07 user nova-compute[72520]:         <nova:project uuid="4a710f41a5a44408a041238b388d588e">tempest-TestVolumeBootPattern-1675749395</nova:project>
Aug 03 00:14:07 user nova-compute[72520]:       </nova:owner>
Aug 03 00:14:07 user nova-compute[72520]:       <nova:ports>
Aug 03 00:14:07 user nova-compute[72520]:         <nova:port uuid="eeb7940b-417f-41f4-9672-7ac729f71979">
Aug 03 00:14:07 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 03 00:14:07 user nova-compute[72520]:         </nova:port>
Aug 03 00:14:07 user nova-compute[72520]:       </nova:ports>
Aug 03 00:14:07 user nova-compute[72520]:     </nova:instance>
Aug 03 00:14:07 user nova-compute[72520]:   </metadata>
Aug 03 00:14:07 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:14:07 user nova-compute[72520]:     <system>
Aug 03 00:14:07 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:14:07 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:14:07 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:14:07 user nova-compute[72520]:       <entry name="serial">4876b7ad-c546-4b5a-aca0-7a9f5aa57101</entry>
Aug 03 00:14:07 user nova-compute[72520]:       <entry name="uuid">4876b7ad-c546-4b5a-aca0-7a9f5aa57101</entry>
Aug 03 00:14:07 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:14:07 user nova-compute[72520]:     </system>
Aug 03 00:14:07 user nova-compute[72520]:   </sysinfo>
Aug 03 00:14:07 user nova-compute[72520]:   <os>
Aug 03 00:14:07 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:14:07 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:14:07 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:14:07 user nova-compute[72520]:   </os>
Aug 03 00:14:07 user nova-compute[72520]:   <features>
Aug 03 00:14:07 user nova-compute[72520]:     <acpi/>
Aug 03 00:14:07 user nova-compute[72520]:     <apic/>
Aug 03 00:14:07 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:14:07 user nova-compute[72520]:   </features>
Aug 03 00:14:07 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:14:07 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:14:07 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:14:07 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:14:07 user nova-compute[72520]:   </clock>
Aug 03 00:14:07 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:14:07 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:14:07 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:14:07 user nova-compute[72520]:   </cpu>
Aug 03 00:14:07 user nova-compute[72520]:   <devices>
Aug 03 00:14:07 user nova-compute[72520]:     <disk type="block" device="disk">
Aug 03 00:14:07 user nova-compute[72520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:14:07 user nova-compute[72520]:       <source dev="/dev/sdc"/>
Aug 03 00:14:07 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:14:07 user nova-compute[72520]:       <serial>d9cd58eb-d45a-43d8-bda5-e0e35f540fdd</serial>
Aug 03 00:14:07 user nova-compute[72520]:     </disk>
Aug 03 00:14:07 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:14:07 user nova-compute[72520]:       <mac address="fa:16:3e:3c:fe:08"/>
Aug 03 00:14:07 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:14:07 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:14:07 user nova-compute[72520]:       <target dev="tapeeb7940b-41"/>
Aug 03 00:14:07 user nova-compute[72520]:     </interface>
Aug 03 00:14:07 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:14:07 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/4876b7ad-c546-4b5a-aca0-7a9f5aa57101/console.log" append="off"/>
Aug 03 00:14:07 user nova-compute[72520]:     </serial>
Aug 03 00:14:07 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:14:07 user nova-compute[72520]:     <video>
Aug 03 00:14:07 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:14:07 user nova-compute[72520]:     </video>
Aug 03 00:14:07 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:14:07 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:14:07 user nova-compute[72520]:     </rng>
Aug 03 00:14:07 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:14:07 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:14:07 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:14:07 user nova-compute[72520]:     </memballoon>
Aug 03 00:14:07 user nova-compute[72520]:   </devices>
Aug 03 00:14:07 user nova-compute[72520]: </domain>
Aug 03 00:14:07 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2129243143',display_name='tempest-TestVolumeBootPattern-server-2129243143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2129243143',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-zkyedh70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:13:58Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=4876b7ad-c546-4b5a-aca0-7a9f5aa57101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:08,bridge_name='br-int',has_traffic_filtering=True,id=eeb7940b-417f-41f4-9672-7ac729f71979,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7940b-41') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG os_vif [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:08,bridge_name='br-int',has_traffic_filtering=True,id=eeb7940b-417f-41f4-9672-7ac729f71979,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7940b-41') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb7940b-41, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeb7940b-41, col_values=(('external_ids', {'iface-id': 'eeb7940b-417f-41f4-9672-7ac729f71979', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:fe:08', 'vm-uuid': '4876b7ad-c546-4b5a-aca0-7a9f5aa57101'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:07 user nova-compute[72520]: INFO os_vif [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:08,bridge_name='br-int',has_traffic_filtering=True,id=eeb7940b-417f-41f4-9672-7ac729f71979,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7940b-41')
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:14:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] No VIF found with MAC fa:16:3e:3c:fe:08, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-c9dff450-7749-42c8-a541-6e47143522d6 req-0977748a-3215-4e37-8bd0-817414c6682e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c9dff450-7749-42c8-a541-6e47143522d6 req-0977748a-3215-4e37-8bd0-817414c6682e service nova] Acquiring lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c9dff450-7749-42c8-a541-6e47143522d6 req-0977748a-3215-4e37-8bd0-817414c6682e service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c9dff450-7749-42c8-a541-6e47143522d6 req-0977748a-3215-4e37-8bd0-817414c6682e service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:08 user nova-compute[72520]: DEBUG nova.compute.manager [req-c9dff450-7749-42c8-a541-6e47143522d6 req-0977748a-3215-4e37-8bd0-817414c6682e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] No waiting events found dispatching network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:14:08 user nova-compute[72520]: WARNING nova.compute.manager [req-c9dff450-7749-42c8-a541-6e47143522d6 req-0977748a-3215-4e37-8bd0-817414c6682e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received unexpected event network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 for instance with vm_state building and task_state spawning.
Aug 03 00:14:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021650.8406217, 4876b7ad-c546-4b5a-aca0-7a9f5aa57101 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:14:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] VM Resumed (Lifecycle Event)
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:14:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Instance spawned successfully.
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:14:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021650.8419545, 4876b7ad-c546-4b5a-aca0-7a9f5aa57101 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:14:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] VM Started (Lifecycle Event)
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:14:10 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:14:10 user nova-compute[72520]: INFO nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 03 00:14:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:14:11 user nova-compute[72520]: INFO nova.compute.manager [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Took 13.13 seconds to build instance.
Aug 03 00:14:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-46dcedce-c229-4f35-9390-4a4dcbdff4f6 req-32d3ac9b-49a3-4098-9db6-d6077a21ae1b service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:14:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-46dcedce-c229-4f35-9390-4a4dcbdff4f6 req-32d3ac9b-49a3-4098-9db6-d6077a21ae1b service nova] Acquiring lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-46dcedce-c229-4f35-9390-4a4dcbdff4f6 req-32d3ac9b-49a3-4098-9db6-d6077a21ae1b service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-46dcedce-c229-4f35-9390-4a4dcbdff4f6 req-32d3ac9b-49a3-4098-9db6-d6077a21ae1b service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:11 user nova-compute[72520]: DEBUG nova.compute.manager [req-46dcedce-c229-4f35-9390-4a4dcbdff4f6 req-32d3ac9b-49a3-4098-9db6-d6077a21ae1b service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] No waiting events found dispatching network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:14:11 user nova-compute[72520]: WARNING nova.compute.manager [req-46dcedce-c229-4f35-9390-4a4dcbdff4f6 req-32d3ac9b-49a3-4098-9db6-d6077a21ae1b service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received unexpected event network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 for instance with vm_state active and task_state None.
Aug 03 00:14:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c24f6569-8466-417b-bfbe-0bf1c58efe44 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.230s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:14:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:14:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:14:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:14:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Updating instance_info_cache with network_info: [{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:14:18 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:14:19 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:14:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:14:24 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:14:24 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=25.22809600830078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d5536440-4428-4947-9230-1dda93617841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 4876b7ad-c546-4b5a-aca0-7a9f5aa57101 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:26 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:26 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:26 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:14:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:14:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:37 user nova-compute[72520]: INFO nova.compute.manager [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Terminating instance
Aug 03 00:14:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Instance destroyed successfully.
Aug 03 00:14:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lazy-loading 'resources' on Instance uuid a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1106919353',display_name='tempest-ServersNegativeTestJSON-server-1106919353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1106919353',id=42,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b23638b890649bebd9d3be398b9451d',ramdisk_id='',reservation_id='r-sx1lifqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-80248803',owner_user_name='tempest-ServersNegativeTestJSON-80248803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:05:53Z,user_data=None,user_id='6361183670f8430ab54cdbcd5f40f8de',uuid=a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converting VIF {"id": "80c7398a-532a-4d1a-97c4-e5188e69722b", "address": "fa:16:3e:9b:e7:50", "network": {"id": "25256b61-fd55-461d-9e89-9495fbe00cbf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684794660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b23638b890649bebd9d3be398b9451d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c7398a-53", "ovs_interfaceid": "80c7398a-532a-4d1a-97c4-e5188e69722b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:e7:50,bridge_name='br-int',has_traffic_filtering=True,id=80c7398a-532a-4d1a-97c4-e5188e69722b,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c7398a-53') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG os_vif [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:e7:50,bridge_name='br-int',has_traffic_filtering=True,id=80c7398a-532a-4d1a-97c4-e5188e69722b,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c7398a-53') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80c7398a-53, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:14:37 user nova-compute[72520]: INFO os_vif [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:e7:50,bridge_name='br-int',has_traffic_filtering=True,id=80c7398a-532a-4d1a-97c4-e5188e69722b,network=Network(25256b61-fd55-461d-9e89-9495fbe00cbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c7398a-53')
Aug 03 00:14:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Deleting instance files /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20_del
Aug 03 00:14:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Deletion of /opt/stack/data/nova/instances/a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20_del complete
Aug 03 00:14:37 user nova-compute[72520]: INFO nova.compute.manager [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 03 00:14:37 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:14:37 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-79b58272-82f5-4360-ab71-b01ee1281cee req-a5f92670-6b78-46ea-affa-b7ff5e07f2c7 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received event network-vif-unplugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-79b58272-82f5-4360-ab71-b01ee1281cee req-a5f92670-6b78-46ea-affa-b7ff5e07f2c7 service nova] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-79b58272-82f5-4360-ab71-b01ee1281cee req-a5f92670-6b78-46ea-affa-b7ff5e07f2c7 service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-79b58272-82f5-4360-ab71-b01ee1281cee req-a5f92670-6b78-46ea-affa-b7ff5e07f2c7 service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-79b58272-82f5-4360-ab71-b01ee1281cee req-a5f92670-6b78-46ea-affa-b7ff5e07f2c7 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] No waiting events found dispatching network-vif-unplugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-79b58272-82f5-4360-ab71-b01ee1281cee req-a5f92670-6b78-46ea-affa-b7ff5e07f2c7 service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received event network-vif-unplugged-80c7398a-532a-4d1a-97c4-e5188e69722b for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:14:38 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Took 0.61 seconds to deallocate network for instance.
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-4009f10f-789e-4550-b813-8a73dfab58cb req-f4b93df3-071f-4ffc-b5cc-993f2962231b service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received event network-vif-deleted-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:14:38 user nova-compute[72520]: INFO nova.compute.manager [req-4009f10f-789e-4550-b813-8a73dfab58cb req-f4b93df3-071f-4ffc-b5cc-993f2962231b service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Neutron deleted interface 80c7398a-532a-4d1a-97c4-e5188e69722b; detaching it from the instance and deleting it from the info cache
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.network.neutron [req-4009f10f-789e-4550-b813-8a73dfab58cb req-f4b93df3-071f-4ffc-b5cc-993f2962231b service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.compute.manager [req-4009f10f-789e-4550-b813-8a73dfab58cb req-f4b93df3-071f-4ffc-b5cc-993f2962231b service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Detach interface failed, port_id=80c7398a-532a-4d1a-97c4-e5188e69722b, reason: Instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 could not be found. {{(pid=72520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:14:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:38 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Deleted allocations for instance a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20
Aug 03 00:14:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8990002d-ee01-4a8f-a1bb-e9a938f9aa04 tempest-ServersNegativeTestJSON-80248803 tempest-ServersNegativeTestJSON-80248803-project-member] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.687s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a83e7f7-aa8f-40d0-a26a-da624718663d req-266d929d-b431-4f47-b140-4e730ee1fdbb service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received event network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:14:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a83e7f7-aa8f-40d0-a26a-da624718663d req-266d929d-b431-4f47-b140-4e730ee1fdbb service nova] Acquiring lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:14:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a83e7f7-aa8f-40d0-a26a-da624718663d req-266d929d-b431-4f47-b140-4e730ee1fdbb service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:14:40 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1a83e7f7-aa8f-40d0-a26a-da624718663d req-266d929d-b431-4f47-b140-4e730ee1fdbb service nova] Lock "a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:14:40 user nova-compute[72520]: DEBUG nova.compute.manager [req-1a83e7f7-aa8f-40d0-a26a-da624718663d req-266d929d-b431-4f47-b140-4e730ee1fdbb service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] No waiting events found dispatching network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:14:40 user nova-compute[72520]: WARNING nova.compute.manager [req-1a83e7f7-aa8f-40d0-a26a-da624718663d req-266d929d-b431-4f47-b140-4e730ee1fdbb service nova] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Received unexpected event network-vif-plugged-80c7398a-532a-4d1a-97c4-e5188e69722b for instance with vm_state deleted and task_state None.
Aug 03 00:14:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:14:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:52 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021677.6999958, a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:14:52 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] VM Stopped (Lifecycle Event)
Aug 03 00:14:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-b546daef-355a-4c27-a4db-5a5ca111c455 None None] [instance: a02ba24d-bf22-4ae6-9eec-a6e7a5d5ed20] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:14:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:14:57 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:15:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:15:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:02 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:07 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:15:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:17 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:17 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:15:19 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:19 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:15:19 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:15:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:15:19 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:15:19 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:15:19 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid d5536440-4428-4947-9230-1dda93617841 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:15:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Updating instance_info_cache with network_info: [{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:15:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:15:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: d5536440-4428-4947-9230-1dda93617841] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:15:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:15:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:15:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:22 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:15:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:15:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.253814697265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d5536440-4428-4947-9230-1dda93617841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 4876b7ad-c546-4b5a-aca0-7a9f5aa57101 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:15:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:15:24 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:15:24 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:15:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:15:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:15:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:15:27 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:32 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:15:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:15:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:37 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:15:42 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:15:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:15:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:15:47 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-changed-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG nova.compute.manager [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Refreshing instance network info cache due to event network-changed-eeb7940b-417f-41f4-9672-7ac729f71979. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] Acquiring lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] Acquired lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Refreshing network info cache for port eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updated VIF entry in instance network info cache for port eeb7940b-417f-41f4-9672-7ac729f71979. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG nova.network.neutron [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updating instance_info_cache with network_info: [{"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:15:50 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-c4b84f08-278b-4387-9406-4d8afc4b1e9e req-f606e766-4d95-4518-95dd-053883e126ef service nova] Releasing lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-changed-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Refreshing instance network info cache due to event network-changed-eeb7940b-417f-41f4-9672-7ac729f71979. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] Acquiring lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] Acquired lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG nova.network.neutron [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Refreshing network info cache for port eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:15:52 user nova-compute[72520]: INFO nova.compute.manager [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Terminating instance
Aug 03 00:15:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG nova.network.neutron [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updated VIF entry in instance network info cache for port eeb7940b-417f-41f4-9672-7ac729f71979. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG nova.network.neutron [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updating instance_info_cache with network_info: [{"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:15:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-17a4faa8-8fb3-40c8-b13a-7f9e33afce90 req-b5cd0662-fbdd-42e2-8a2c-f7e38ab4650e service nova] Releasing lock "refresh_cache-4876b7ad-c546-4b5a-aca0-7a9f5aa57101" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-bbef06c4-ec8e-48c2-bd29-881a83751b7f req-08e5904b-7416-4063-b072-b2b2d7794141 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-vif-unplugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bbef06c4-ec8e-48c2-bd29-881a83751b7f req-08e5904b-7416-4063-b072-b2b2d7794141 service nova] Acquiring lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bbef06c4-ec8e-48c2-bd29-881a83751b7f req-08e5904b-7416-4063-b072-b2b2d7794141 service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bbef06c4-ec8e-48c2-bd29-881a83751b7f req-08e5904b-7416-4063-b072-b2b2d7794141 service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-bbef06c4-ec8e-48c2-bd29-881a83751b7f req-08e5904b-7416-4063-b072-b2b2d7794141 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] No waiting events found dispatching network-vif-unplugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.compute.manager [req-bbef06c4-ec8e-48c2-bd29-881a83751b7f req-08e5904b-7416-4063-b072-b2b2d7794141 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-vif-unplugged-eeb7940b-417f-41f4-9672-7ac729f71979 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Instance destroyed successfully.
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'resources' on Instance uuid 4876b7ad-c546-4b5a-aca0-7a9f5aa57101 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2129243143',display_name='tempest-TestVolumeBootPattern-server-2129243143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2129243143',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:14:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-zkyedh70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:14:11Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=4876b7ad-c546-4b5a-aca0-7a9f5aa57101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "eeb7940b-417f-41f4-9672-7ac729f71979", "address": "fa:16:3e:3c:fe:08", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb7940b-41", "ovs_interfaceid": "eeb7940b-417f-41f4-9672-7ac729f71979", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fe:08,bridge_name='br-int',has_traffic_filtering=True,id=eeb7940b-417f-41f4-9672-7ac729f71979,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7940b-41') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_vif [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fe:08,bridge_name='br-int',has_traffic_filtering=True,id=eeb7940b-417f-41f4-9672-7ac729f71979,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7940b-41') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb7940b-41, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:15:53 user nova-compute[72520]: INFO os_vif [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fe:08,bridge_name='br-int',has_traffic_filtering=True,id=eeb7940b-417f-41f4-9672-7ac729f71979,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb7940b-41')
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHqNPtOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:15:53 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e5ffd-6213-4ea2-837f-45612fbe6f0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a27de3-c543-4e02-b5b8-66bd6f7297a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f49361ee-3c0c-4d4f-919e-e9748578d568\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8101b4c-edfa-4b6d-b0f7-0549aa5ce1ca]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49361ee-3c0c-4d4f-919e-e9748578d568 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a27de3-c543-4e02-b5b8-66bd6f7297a3 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:15:53 user nova-compute[72520]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd (non-flash)
Aug 03 00:15:53 user nova-compute[72520]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49361ee-3c0c-4d4f-919e-e9748578d568 (non-flash)
Aug 03 00:15:53 user nova-compute[72520]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a27de3-c543-4e02-b5b8-66bd6f7297a3 (non-flash)
Aug 03 00:15:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:15:53 user nova-compute[72520]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd (non-flash)
Aug 03 00:15:53 user nova-compute[72520]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f49361ee-3c0c-4d4f-919e-e9748578d568 (non-flash)
Aug 03 00:15:53 user nova-compute[72520]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a27de3-c543-4e02-b5b8-66bd6f7297a3 (non-flash)
Aug 03 00:15:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cc46780d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd'): ({'sdc'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Removing single pathed devices sdc {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f15c454-b19b-4a08-9ca3-15e7908cdeb6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[41944d9b-14aa-4fdb-9e12-ec84c5590574]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flushing IO for device /dev/sdc {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2109bca7-d15f-4fa4-adea-d36f91bfe71e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2d5c2-0eba-47ee-a781-4fd76e00c3d3]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] SCSI volumes sdc have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2705f69a-e7cc2f5649b513b6', '/dev/disk/by-id/scsi-26537636332663536', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2705f69a') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68b371b-6c2a-4611-8b07-68a48d23a0ed]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3146b609-7a8a-4b2d-95a1-1edd3c057e70]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ca630b-7d95-410f-904c-5d0611de7833]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260]
Aug 03 00:15:53 user nova-compute[72520]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd, portal: 172.16.0.220,3260] successful.
Aug 03 00:15:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9cd58eb-d45a-43d8-bda5-e0e35f540fdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09778c48-6cf9-4f04-b2f5-83376986a050]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== disconnect_volume: return (318ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:15:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Deleting instance files /opt/stack/data/nova/instances/4876b7ad-c546-4b5a-aca0-7a9f5aa57101_del
Aug 03 00:15:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Deletion of /opt/stack/data/nova/instances/4876b7ad-c546-4b5a-aca0-7a9f5aa57101_del complete
Aug 03 00:15:53 user nova-compute[72520]: INFO nova.compute.manager [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 03 00:15:53 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:54 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:15:54 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Took 0.52 seconds to deallocate network for instance.
Aug 03 00:15:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-d07f6d73-0cdb-4efb-8c5f-d61db47a8107 req-41f94315-a2e8-4840-96df-56b49e1da5bb service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-vif-deleted-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:15:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:15:54 user nova-compute[72520]: INFO nova.compute.manager [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Took 0.75 seconds to detach 1 volumes for instance.
Aug 03 00:15:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-1d848bf1-6104-4333-a88e-16028fb64932 req-b2e9ba79-536b-4517-b59e-3cd388915e45 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received event network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1d848bf1-6104-4333-a88e-16028fb64932 req-b2e9ba79-536b-4517-b59e-3cd388915e45 service nova] Acquiring lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1d848bf1-6104-4333-a88e-16028fb64932 req-b2e9ba79-536b-4517-b59e-3cd388915e45 service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1d848bf1-6104-4333-a88e-16028fb64932 req-b2e9ba79-536b-4517-b59e-3cd388915e45 service nova] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG nova.compute.manager [req-1d848bf1-6104-4333-a88e-16028fb64932 req-b2e9ba79-536b-4517-b59e-3cd388915e45 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] No waiting events found dispatching network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:15:55 user nova-compute[72520]: WARNING nova.compute.manager [req-1d848bf1-6104-4333-a88e-16028fb64932 req-b2e9ba79-536b-4517-b59e-3cd388915e45 service nova] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Received unexpected event network-vif-plugged-eeb7940b-417f-41f4-9672-7ac729f71979 for instance with vm_state deleted and task_state None.
Aug 03 00:15:55 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:15:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:15:55 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Deleted allocations for instance 4876b7ad-c546-4b5a-aca0-7a9f5aa57101
Aug 03 00:15:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-8aa3a999-a01b-45c7-9fc9-e95c55ff3bdb tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "4876b7ad-c546-4b5a-aca0-7a9f5aa57101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.897s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:15:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:16:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:16:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:16:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:16:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:16:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:08 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021753.2368302, 4876b7ad-c546-4b5a-aca0-7a9f5aa57101 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:16:08 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] VM Stopped (Lifecycle Event)
Aug 03 00:16:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-769fa814-e3fe-4923-9607-8ed92faa36bf None None] [instance: 4876b7ad-c546-4b5a-aca0-7a9f5aa57101] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:16:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:16 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:16:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 00:16:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:16:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:16:23 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:16:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.250316619873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance d5536440-4428-4947-9230-1dda93617841 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:16:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:16:24 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:16:24 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:16:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:16:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:16:29 user nova-compute[72520]: INFO nova.compute.claims [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Claim successful on node user
Aug 03 00:16:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:16:29 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:16:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.policy [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48c32aebdc4c4b328ea62e01c07183aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c3ec307a934b0bb75dba746db16fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:16:30 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Creating image(s)
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "/opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "/opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk 1073741824" returned: 0 in 0.063s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Successfully created port: ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Cannot resize image /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'migration_context' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Ensure instance console log exists: /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Successfully updated port: ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquired lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-changed-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.compute.manager [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Refreshing instance network info cache due to event network-changed-ba44a6a0-de4f-4594-8c03-80ccfbd2edca. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] Acquiring lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.neutron [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updating instance_info_cache with network_info: [{"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Releasing lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Instance network_info: |[{"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] Acquired lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.neutron [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Refreshing network info cache for port ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Start _get_guest_xml network_info=[{"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:16:31 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:16:31 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1635188580',display_name='tempest-VolumesSnapshotTestJSON-instance-1635188580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1635188580',id=50,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaUWhSk8+KiVKMKVQDn4SiyX54KtMaELD4oZRD5TbzkIkk1kYuvB8Size5oPdC2Ofqqs1t9DqnAhizfQ19RRakElZOZDZTrqV03eZ5NnKGtCaU7+8QyyR4HfZlQ9s57FQ==',key_name='tempest-keypair-609709633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c3ec307a934b0bb75dba746db16fd6',ramdisk_id='',reservation_id='r-fxexoug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1802936978',owner_user_name='tempest-VolumesSnapshotTestJSON-1802936978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:16:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c32aebdc4c4b328ea62e01c07183aa',uuid=0f326817-86f3-4c49-b78c-6329dee8eb87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converting VIF {"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba44a6a0-de4f-4594-8c03-80ccfbd2edca,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba44a6a0-de') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.objects.instance [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:16:31 user nova-compute[72520]:   <uuid>0f326817-86f3-4c49-b78c-6329dee8eb87</uuid>
Aug 03 00:16:31 user nova-compute[72520]:   <name>instance-00000032</name>
Aug 03 00:16:31 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:16:31 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:16:31 user nova-compute[72520]:   <metadata>
Aug 03 00:16:31 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:16:31 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:16:31 user nova-compute[72520]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1635188580</nova:name>
Aug 03 00:16:31 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:16:31</nova:creationTime>
Aug 03 00:16:31 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:16:31 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:16:31 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:16:31 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:16:31 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:16:31 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:16:31 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:16:31 user nova-compute[72520]:       <nova:owner>
Aug 03 00:16:31 user nova-compute[72520]:         <nova:user uuid="48c32aebdc4c4b328ea62e01c07183aa">tempest-VolumesSnapshotTestJSON-1802936978-project-member</nova:user>
Aug 03 00:16:31 user nova-compute[72520]:         <nova:project uuid="d5c3ec307a934b0bb75dba746db16fd6">tempest-VolumesSnapshotTestJSON-1802936978</nova:project>
Aug 03 00:16:31 user nova-compute[72520]:       </nova:owner>
Aug 03 00:16:31 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:16:31 user nova-compute[72520]:       <nova:ports>
Aug 03 00:16:31 user nova-compute[72520]:         <nova:port uuid="ba44a6a0-de4f-4594-8c03-80ccfbd2edca">
Aug 03 00:16:31 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 03 00:16:31 user nova-compute[72520]:         </nova:port>
Aug 03 00:16:31 user nova-compute[72520]:       </nova:ports>
Aug 03 00:16:31 user nova-compute[72520]:     </nova:instance>
Aug 03 00:16:31 user nova-compute[72520]:   </metadata>
Aug 03 00:16:31 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:16:31 user nova-compute[72520]:     <system>
Aug 03 00:16:31 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:16:31 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:16:31 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:16:31 user nova-compute[72520]:       <entry name="serial">0f326817-86f3-4c49-b78c-6329dee8eb87</entry>
Aug 03 00:16:31 user nova-compute[72520]:       <entry name="uuid">0f326817-86f3-4c49-b78c-6329dee8eb87</entry>
Aug 03 00:16:31 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:16:31 user nova-compute[72520]:     </system>
Aug 03 00:16:31 user nova-compute[72520]:   </sysinfo>
Aug 03 00:16:31 user nova-compute[72520]:   <os>
Aug 03 00:16:31 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:16:31 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:16:31 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:16:31 user nova-compute[72520]:   </os>
Aug 03 00:16:31 user nova-compute[72520]:   <features>
Aug 03 00:16:31 user nova-compute[72520]:     <acpi/>
Aug 03 00:16:31 user nova-compute[72520]:     <apic/>
Aug 03 00:16:31 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:16:31 user nova-compute[72520]:   </features>
Aug 03 00:16:31 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:16:31 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:16:31 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:16:31 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:16:31 user nova-compute[72520]:   </clock>
Aug 03 00:16:31 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:16:31 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:16:31 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:16:31 user nova-compute[72520]:   </cpu>
Aug 03 00:16:31 user nova-compute[72520]:   <devices>
Aug 03 00:16:31 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:16:31 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:16:31 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk"/>
Aug 03 00:16:31 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:16:31 user nova-compute[72520]:     </disk>
Aug 03 00:16:31 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:16:31 user nova-compute[72520]:       <mac address="fa:16:3e:ff:91:b4"/>
Aug 03 00:16:31 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:16:31 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:16:31 user nova-compute[72520]:       <target dev="tapba44a6a0-de"/>
Aug 03 00:16:31 user nova-compute[72520]:     </interface>
Aug 03 00:16:31 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:16:31 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/console.log" append="off"/>
Aug 03 00:16:31 user nova-compute[72520]:     </serial>
Aug 03 00:16:31 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:16:31 user nova-compute[72520]:     <video>
Aug 03 00:16:31 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:16:31 user nova-compute[72520]:     </video>
Aug 03 00:16:31 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:16:31 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:16:31 user nova-compute[72520]:     </rng>
Aug 03 00:16:31 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:16:31 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:16:31 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:16:31 user nova-compute[72520]:     </memballoon>
Aug 03 00:16:31 user nova-compute[72520]:   </devices>
Aug 03 00:16:31 user nova-compute[72520]: </domain>
Aug 03 00:16:31 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1635188580',display_name='tempest-VolumesSnapshotTestJSON-instance-1635188580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1635188580',id=50,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaUWhSk8+KiVKMKVQDn4SiyX54KtMaELD4oZRD5TbzkIkk1kYuvB8Size5oPdC2Ofqqs1t9DqnAhizfQ19RRakElZOZDZTrqV03eZ5NnKGtCaU7+8QyyR4HfZlQ9s57FQ==',key_name='tempest-keypair-609709633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c3ec307a934b0bb75dba746db16fd6',ramdisk_id='',reservation_id='r-fxexoug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1802936978',owner_user_name='tempest-VolumesSnapshotTestJSON-1802936978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:16:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c32aebdc4c4b328ea62e01c07183aa',uuid=0f326817-86f3-4c49-b78c-6329dee8eb87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converting VIF {"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba44a6a0-de4f-4594-8c03-80ccfbd2edca,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba44a6a0-de') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG os_vif [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba44a6a0-de4f-4594-8c03-80ccfbd2edca,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba44a6a0-de') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba44a6a0-de, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba44a6a0-de, col_values=(('external_ids', {'iface-id': 'ba44a6a0-de4f-4594-8c03-80ccfbd2edca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:91:b4', 'vm-uuid': '0f326817-86f3-4c49-b78c-6329dee8eb87'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:31 user nova-compute[72520]: INFO os_vif [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba44a6a0-de4f-4594-8c03-80ccfbd2edca,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba44a6a0-de')
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:16:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No VIF found with MAC fa:16:3e:ff:91:b4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:16:32 user nova-compute[72520]: DEBUG nova.network.neutron [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updated VIF entry in instance network info cache for port ba44a6a0-de4f-4594-8c03-80ccfbd2edca. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:16:32 user nova-compute[72520]: DEBUG nova.network.neutron [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updating instance_info_cache with network_info: [{"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:16:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d4b9204e-5754-4b93-8be0-4e4abb94f41a req-76305ae5-a0f1-4b8b-befc-cff2389bacfd service nova] Releasing lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-2885e010-da9e-4003-8bc1-ae6fd93e17b4 req-71cb6b5c-7458-4af8-b65c-9d4f7599c8ac service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2885e010-da9e-4003-8bc1-ae6fd93e17b4 req-71cb6b5c-7458-4af8-b65c-9d4f7599c8ac service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2885e010-da9e-4003-8bc1-ae6fd93e17b4 req-71cb6b5c-7458-4af8-b65c-9d4f7599c8ac service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-2885e010-da9e-4003-8bc1-ae6fd93e17b4 req-71cb6b5c-7458-4af8-b65c-9d4f7599c8ac service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG nova.compute.manager [req-2885e010-da9e-4003-8bc1-ae6fd93e17b4 req-71cb6b5c-7458-4af8-b65c-9d4f7599c8ac service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:16:33 user nova-compute[72520]: WARNING nova.compute.manager [req-2885e010-da9e-4003-8bc1-ae6fd93e17b4 req-71cb6b5c-7458-4af8-b65c-9d4f7599c8ac service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received unexpected event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with vm_state building and task_state spawning.
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021795.5297456, 0f326817-86f3-4c49-b78c-6329dee8eb87 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:16:35 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] VM Resumed (Lifecycle Event)
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:16:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Instance spawned successfully.
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:16:35 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691021795.531056, 0f326817-86f3-4c49-b78c-6329dee8eb87 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:16:35 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] VM Started (Lifecycle Event)
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-ea6a9104-867c-44d8-b3dd-fda1fc8dd1e7 req-f72d9008-a201-46da-aea4-2bac1bd2be75 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea6a9104-867c-44d8-b3dd-fda1fc8dd1e7 req-f72d9008-a201-46da-aea4-2bac1bd2be75 service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea6a9104-867c-44d8-b3dd-fda1fc8dd1e7 req-f72d9008-a201-46da-aea4-2bac1bd2be75 service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ea6a9104-867c-44d8-b3dd-fda1fc8dd1e7 req-f72d9008-a201-46da-aea4-2bac1bd2be75 service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [req-ea6a9104-867c-44d8-b3dd-fda1fc8dd1e7 req-f72d9008-a201-46da-aea4-2bac1bd2be75 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:16:35 user nova-compute[72520]: WARNING nova.compute.manager [req-ea6a9104-867c-44d8-b3dd-fda1fc8dd1e7 req-f72d9008-a201-46da-aea4-2bac1bd2be75 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received unexpected event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with vm_state building and task_state spawning.
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:16:35 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:16:35 user nova-compute[72520]: INFO nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 03 00:16:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:16:35 user nova-compute[72520]: INFO nova.compute.manager [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Took 6.08 seconds to build instance.
Aug 03 00:16:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-c129d701-ceb9-495f-99a4-e4d1955ebf67 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.171s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:36 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:41 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:46 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-changed-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Refreshing instance network info cache due to event network-changed-728d8ed4-9435-4179-99c2-77bab6d908ed. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] Acquiring lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] Acquired lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG nova.network.neutron [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Refreshing network info cache for port 728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "d5536440-4428-4947-9230-1dda93617841" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "d5536440-4428-4947-9230-1dda93617841" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "d5536440-4428-4947-9230-1dda93617841-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "d5536440-4428-4947-9230-1dda93617841-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "d5536440-4428-4947-9230-1dda93617841-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:52 user nova-compute[72520]: INFO nova.compute.manager [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Terminating instance
Aug 03 00:16:52 user nova-compute[72520]: DEBUG nova.compute.manager [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-d739d337-d6f6-4db4-af27-802a7a24caf9 req-c6cb613c-8160-4bfe-a8f6-6c12cecd7165 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-vif-unplugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d739d337-d6f6-4db4-af27-802a7a24caf9 req-c6cb613c-8160-4bfe-a8f6-6c12cecd7165 service nova] Acquiring lock "d5536440-4428-4947-9230-1dda93617841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d739d337-d6f6-4db4-af27-802a7a24caf9 req-c6cb613c-8160-4bfe-a8f6-6c12cecd7165 service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d739d337-d6f6-4db4-af27-802a7a24caf9 req-c6cb613c-8160-4bfe-a8f6-6c12cecd7165 service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-d739d337-d6f6-4db4-af27-802a7a24caf9 req-c6cb613c-8160-4bfe-a8f6-6c12cecd7165 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] No waiting events found dispatching network-vif-unplugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:16:52 user nova-compute[72520]: DEBUG nova.compute.manager [req-d739d337-d6f6-4db4-af27-802a7a24caf9 req-c6cb613c-8160-4bfe-a8f6-6c12cecd7165 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-vif-unplugged-728d8ed4-9435-4179-99c2-77bab6d908ed for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Updated VIF entry in instance network info cache for port 728d8ed4-9435-4179-99c2-77bab6d908ed. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.network.neutron [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Updating instance_info_cache with network_info: [{"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d8ab5aaf-ce01-4433-98e9-ae5e5f9d858f req-dcacf744-f424-47d9-a6fe-3dd3bae7cc60 service nova] Releasing lock "refresh_cache-d5536440-4428-4947-9230-1dda93617841" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:16:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: d5536440-4428-4947-9230-1dda93617841] Instance destroyed successfully.
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.objects.instance [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lazy-loading 'resources' on Instance uuid d5536440-4428-4947-9230-1dda93617841 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1488271112',display_name='tempest-TestVolumeBootPattern-server-1488271112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1488271112',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9VSM/Ao8qVv6uyR55hD6w+vaj4F29h8JwGVgQDBGXM/E5t5uHaJbiTxj8ZWvIty7apQTTuPelCpBufs7gS3N6DeYcbupr7kCjtRR1MlrSctFr3vtTvfUUC1Ugy19PHAg==',key_name='tempest-TestVolumeBootPattern-989975568',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:12:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a710f41a5a44408a041238b388d588e',ramdisk_id='',reservation_id='r-csnx7kp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1675749395',owner_user_name='tempest-TestVolumeBootPattern-1675749395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:12:11Z,user_data=None,user_id='53f4f73d9df5413590eb77ae2b94090d',uuid=d5536440-4428-4947-9230-1dda93617841,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converting VIF {"id": "728d8ed4-9435-4179-99c2-77bab6d908ed", "address": "fa:16:3e:04:c6:61", "network": {"id": "95b8dc7d-98cb-4920-8b03-41c39aadc9dd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1315290816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a710f41a5a44408a041238b388d588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d8ed4-94", "ovs_interfaceid": "728d8ed4-9435-4179-99c2-77bab6d908ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:c6:61,bridge_name='br-int',has_traffic_filtering=True,id=728d8ed4-9435-4179-99c2-77bab6d908ed,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d8ed4-94') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_vif [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c6:61,bridge_name='br-int',has_traffic_filtering=True,id=728d8ed4-9435-4179-99c2-77bab6d908ed,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d8ed4-94') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap728d8ed4-94, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:53 user nova-compute[72520]: INFO os_vif [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c6:61,bridge_name='br-int',has_traffic_filtering=True,id=728d8ed4-9435-4179-99c2-77bab6d908ed,network=Network(95b8dc7d-98cb-4920-8b03-41c39aadc9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d8ed4-94')
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJVHPCXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:16:53 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896b630-66e4-46df-b114-808296b38ee3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b8912-0c74-475b-b830-3e8ad704bd4a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:16:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 (non-flash)
Aug 03 00:16:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce427b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5909c086-f8a1-422f-b805-81ae44a47bd7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0523652b-201d-4c9b-8929-800fb98f8f15]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0abf14-11d3-4119-af8c-2bbdd1824bd4]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aacbb02-9e37-4235-adfd-a7f5fce28c4d]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_30dd9d3e', '/dev/disk/by-id/scsi-1SCST_BIO30dd9d3e-2e4e43c1a5eca50c', '/dev/disk/by-id/scsi-23265346534336331') {{(pid=83015) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4626d7-9672-4100-8d88-48c53ecadef5]: (4, None) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcf5667-cbc2-403c-a487-1a44e7e8f5cc]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ee18d-b754-45df-b20d-9d946eb7a6ac]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260]
Aug 03 00:16:53 user nova-compute[72520]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7, portal: 172.16.0.220,3260] successful.
Aug 03 00:16:53 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91a3508-a173-4bd6-8a65-1b27dc45b8c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a530a3b0-e2db-46c6-8160-136213d3c483]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] <== disconnect_volume: return (253ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:16:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Deleting instance files /opt/stack/data/nova/instances/d5536440-4428-4947-9230-1dda93617841_del
Aug 03 00:16:53 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Deletion of /opt/stack/data/nova/instances/d5536440-4428-4947-9230-1dda93617841_del complete
Aug 03 00:16:53 user nova-compute[72520]: INFO nova.compute.manager [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 03 00:16:53 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: d5536440-4428-4947-9230-1dda93617841] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:16:53 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: d5536440-4428-4947-9230-1dda93617841] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:16:54 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: d5536440-4428-4947-9230-1dda93617841] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:16:54 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: d5536440-4428-4947-9230-1dda93617841] Took 0.49 seconds to deallocate network for instance.
Aug 03 00:16:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-22061c06-6db9-41c6-a03b-65425eddcc55 req-a408336b-6c26-4269-84ed-d8cdd5afd418 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-vif-deleted-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:16:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-aa70c0d6-91a0-4a52-a578-f42089285c24 req-9759b428-e093-40c1-b89d-ec3565c07b10 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received event network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:16:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-aa70c0d6-91a0-4a52-a578-f42089285c24 req-9759b428-e093-40c1-b89d-ec3565c07b10 service nova] Acquiring lock "d5536440-4428-4947-9230-1dda93617841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-aa70c0d6-91a0-4a52-a578-f42089285c24 req-9759b428-e093-40c1-b89d-ec3565c07b10 service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:54 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-aa70c0d6-91a0-4a52-a578-f42089285c24 req-9759b428-e093-40c1-b89d-ec3565c07b10 service nova] Lock "d5536440-4428-4947-9230-1dda93617841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:54 user nova-compute[72520]: DEBUG nova.compute.manager [req-aa70c0d6-91a0-4a52-a578-f42089285c24 req-9759b428-e093-40c1-b89d-ec3565c07b10 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] No waiting events found dispatching network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:16:54 user nova-compute[72520]: WARNING nova.compute.manager [req-aa70c0d6-91a0-4a52-a578-f42089285c24 req-9759b428-e093-40c1-b89d-ec3565c07b10 service nova] [instance: d5536440-4428-4947-9230-1dda93617841] Received unexpected event network-vif-plugged-728d8ed4-9435-4179-99c2-77bab6d908ed for instance with vm_state active and task_state deleting.
Aug 03 00:16:54 user nova-compute[72520]: INFO nova.compute.manager [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] [instance: d5536440-4428-4947-9230-1dda93617841] Took 0.73 seconds to detach 1 volumes for instance.
Aug 03 00:16:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:16:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:16:55 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:16:55 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:16:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:55 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Deleted allocations for instance d5536440-4428-4947-9230-1dda93617841
Aug 03 00:16:55 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4247b681-a527-4c5c-9913-3edb3e401bf8 tempest-TestVolumeBootPattern-1675749395 tempest-TestVolumeBootPattern-1675749395-project-member] Lock "d5536440-4428-4947-9230-1dda93617841" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:16:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:16:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:08 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021813.3888488, d5536440-4428-4947-9230-1dda93617841 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:17:08 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: d5536440-4428-4947-9230-1dda93617841] VM Stopped (Lifecycle Event)
Aug 03 00:17:08 user nova-compute[72520]: DEBUG nova.compute.manager [None req-f65bfbdb-0bf5-4785-b5a8-888ba24812bf None None] [instance: d5536440-4428-4947-9230-1dda93617841] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:17:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:17:16 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:17:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updating instance_info_cache with network_info: [{"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:17:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:17:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:17:23 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:17:24 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:17:24 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:17:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.212276458740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0f326817-86f3-4c49-b78c-6329dee8eb87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:17:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:27 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 00:17:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:17:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:17:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 00:17:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 00:17:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:17:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:17:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:17:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:17:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:17:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:17:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:17:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:17:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:17:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:56 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:17:56 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 00:17:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:17:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:17:56 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:17:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:17:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:18:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:18:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:18:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:18:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:18:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:18 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:18:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:18:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:18:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:18:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:18:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:18:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:18:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:18:20 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:18:20 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updating instance_info_cache with network_info: [{"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-changed-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG nova.compute.manager [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Refreshing instance network info cache due to event network-changed-ba44a6a0-de4f-4594-8c03-80ccfbd2edca. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] Acquiring lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] Acquired lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG nova.network.neutron [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Refreshing network info cache for port ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'flavor' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:18:22 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Ignoring supplied device name: /dev/vdb
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:22 user nova-compute[72520]: INFO nova.compute.manager [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Attaching volume 63ce890e-e9c4-4657-be29-de1dfc00a05f to /dev/vdb
Aug 03 00:18:22 user nova-compute[72520]: DEBUG os_brick.utils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da9f28-3434-495e-8176-22c6d3e6ccc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b8790-7e4e-4e4c-9177-1c3143039d07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c2ade0-29ec-4b31-ae4d-caabd8429326]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51a7b1f-889a-45fd-a840-a21b7a3a37e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:18:22 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[000aa782-c133-4a2c-994b-5f676ff239cb]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG os_brick.utils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updating existing volume attachment record: be50a978-73e1-4746-ab4b-499e4e65b31a {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG nova.network.neutron [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updated VIF entry in instance network info cache for port ba44a6a0-de4f-4594-8c03-80ccfbd2edca. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG nova.network.neutron [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updating instance_info_cache with network_info: [{"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:18:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-66cf91e5-e46d-4e94-a558-1360ab0feed2 req-8d8c6fbb-ebc3-4865-b623-ea964f1b5ba9 service nova] Releasing lock "refresh_cache-0f326817-86f3-4c49-b78c-6329dee8eb87" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:18:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:18:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:26 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:18:26 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.210861206054688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 0f326817-86f3-4c49-b78c-6329dee8eb87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:18:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:18:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDIoctsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:18:29 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:18:29 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:18:29 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e84e09-24be-4153-9105-2f3e659ce45d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:18:29 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99ca529-5285-4a1b-9c39-94b2f3bb28ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f] added
Aug 03 00:18:29 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2db9dde-7afc-45ee-b364-bbe611c9cb4d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb4d47f-c82d-40e3-b8c7-831a64bdab6d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDIoctsR {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDIoctsR" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e72aa0-a800-49ec-a805-e45824587e11]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KDIoctsR'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c03ba-16d6-4b74-9aca-0ac06986e638]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[079c2a59-11d0-4524-afcf-df520da8899f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:18:29 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:18:29 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:18:29 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:18:29 user nova-compute[72520]: 
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31de3cc-5386-485c-834e-e3228b4f7244]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260]
Aug 03 00:18:29 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260] successful.
Aug 03 00:18:29 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66831fd-1e24-42c4-92d0-e4e3fea0fc95]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060940f-d1f8-4a36-887c-481b878508e0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f (non-flash)
Aug 03 00:18:29 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f (non-flash)
Aug 03 00:18:29 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[932edf5c-e4c5-4663-a786-6a9f54a05ae5]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDIoctsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:18:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23866376465363963', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866376465363963', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG nova.objects.instance [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'flavor' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:18:30 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:18:30 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:18:30 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:18:30 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:18:30 user nova-compute[72520]:   <serial>63ce890e-e9c4-4657-be29-de1dfc00a05f</serial>
Aug 03 00:18:30 user nova-compute[72520]: </disk>
Aug 03 00:18:30 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:18:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:18:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:18:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No VIF found with MAC fa:16:3e:ff:91:b4, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:18:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-52613223-865d-48b6-ac7b-bd36c103a78e tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.080s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:18:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:18:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:18:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:57 user nova-compute[72520]: INFO nova.compute.manager [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Detaching volume 63ce890e-e9c4-4657-be29-de1dfc00a05f
Aug 03 00:18:57 user nova-compute[72520]: INFO nova.virt.block_device [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Attempting to driver detach volume 63ce890e-e9c4-4657-be29-de1dfc00a05f from mountpoint /dev/vdb
Aug 03 00:18:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Attempting to detach device vdb from instance 0f326817-86f3-4c49-b78c-6329dee8eb87 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:18:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:18:57 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:18:57 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:18:57 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:18:57 user nova-compute[72520]:   <serial>63ce890e-e9c4-4657-be29-de1dfc00a05f</serial>
Aug 03 00:18:57 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:18:57 user nova-compute[72520]: </disk>
Aug 03 00:18:57 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:18:57 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully detached device vdb from instance 0f326817-86f3-4c49-b78c-6329dee8eb87 from the persistent domain config.
Aug 03 00:18:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f326817-86f3-4c49-b78c-6329dee8eb87 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:18:57 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:18:57 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:18:57 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:18:57 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:18:57 user nova-compute[72520]:   <serial>63ce890e-e9c4-4657-be29-de1dfc00a05f</serial>
Aug 03 00:18:57 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:18:57 user nova-compute[72520]: </disk>
Aug 03 00:18:57 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:18:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691021938.3055685, 0f326817-86f3-4c49-b78c-6329dee8eb87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:18:58 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully detached device vdb from instance 0f326817-86f3-4c49-b78c-6329dee8eb87 from the live domain config.
Aug 03 00:18:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDIoctsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:18:58 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d0db2d-d658-45ba-9886-730bc4bed23c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e1cf34-6805-470a-ac9f-d0c6cfe6e735]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f (non-flash)
Aug 03 00:18:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f (non-flash)
Aug 03 00:18:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4694700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b65a9-1125-48d8-8563-e1dc047968b8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04ebda-0c86-477e-803f-e65710eb4eac]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c06999-8572-4649-8a63-4b2ea6584679]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cff137-745d-4ab7-8b7a-9e4972627870]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c58603-e144-4ed6-baf5-02cbabb92a17]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f79fa9-da8a-44c0-a9a2-9bb287096d8b]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260]
Aug 03 00:18:58 user nova-compute[72520]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f, portal: 172.16.0.220,3260] successful.
Aug 03 00:18:58 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6132b7d-b0ef-48d3-b07c-e353d7265577]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== disconnect_volume: return (257ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:18:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG nova.objects.instance [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'flavor' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-65f0ff02-4b68-4230-a336-143b2954f73f tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.495s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:18:59 user nova-compute[72520]: INFO nova.compute.manager [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Terminating instance
Aug 03 00:18:59 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-3bcc1492-416a-4c92-b78a-2746d8f1e25e req-43a011fb-fa05-483d-9685-f3cc8117a278 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-unplugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3bcc1492-416a-4c92-b78a-2746d8f1e25e req-43a011fb-fa05-483d-9685-f3cc8117a278 service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3bcc1492-416a-4c92-b78a-2746d8f1e25e req-43a011fb-fa05-483d-9685-f3cc8117a278 service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3bcc1492-416a-4c92-b78a-2746d8f1e25e req-43a011fb-fa05-483d-9685-f3cc8117a278 service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-3bcc1492-416a-4c92-b78a-2746d8f1e25e req-43a011fb-fa05-483d-9685-f3cc8117a278 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-unplugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG nova.compute.manager [req-3bcc1492-416a-4c92-b78a-2746d8f1e25e req-43a011fb-fa05-483d-9685-f3cc8117a278 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-unplugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:18:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Instance destroyed successfully.
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'resources' on Instance uuid 0f326817-86f3-4c49-b78c-6329dee8eb87 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1635188580',display_name='tempest-VolumesSnapshotTestJSON-instance-1635188580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1635188580',id=50,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaUWhSk8+KiVKMKVQDn4SiyX54KtMaELD4oZRD5TbzkIkk1kYuvB8Size5oPdC2Ofqqs1t9DqnAhizfQ19RRakElZOZDZTrqV03eZ5NnKGtCaU7+8QyyR4HfZlQ9s57FQ==',key_name='tempest-keypair-609709633',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c3ec307a934b0bb75dba746db16fd6',ramdisk_id='',reservation_id='r-fxexoug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1802936978',owner_user_name='tempest-VolumesSnapshotTestJSON-1802936978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c32aebdc4c4b328ea62e01c07183aa',uuid=0f326817-86f3-4c49-b78c-6329dee8eb87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converting VIF {"id": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "address": "fa:16:3e:ff:91:b4", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba44a6a0-de", "ovs_interfaceid": "ba44a6a0-de4f-4594-8c03-80ccfbd2edca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba44a6a0-de4f-4594-8c03-80ccfbd2edca,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba44a6a0-de') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_vif [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba44a6a0-de4f-4594-8c03-80ccfbd2edca,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba44a6a0-de') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba44a6a0-de, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:00 user nova-compute[72520]: INFO os_vif [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:91:b4,bridge_name='br-int',has_traffic_filtering=True,id=ba44a6a0-de4f-4594-8c03-80ccfbd2edca,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba44a6a0-de')
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDIoctsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:19:00 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63ce890e-e9c4-4657-be29-de1dfc00a05f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3eae2-a190-4256-ba8c-8b78de0562a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:19:00 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 03 00:19:00 user nova-compute[72520]: 
Aug 03 00:19:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0606f84c-52a2-4612-a256-d3e630ee821d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:19:00 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:19:00 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:19:00 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:19:00 user nova-compute[72520]: 
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cfc1396c0>, {}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Disconnecting from: [] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== disconnect_volume: return (42ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:19:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Deleting instance files /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87_del
Aug 03 00:19:00 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Deletion of /opt/stack/data/nova/instances/0f326817-86f3-4c49-b78c-6329dee8eb87_del complete
Aug 03 00:19:00 user nova-compute[72520]: INFO nova.compute.manager [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 03 00:19:00 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:19:01 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Took 0.87 seconds to deallocate network for instance.
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-8819503c-2b8b-46c6-a7c8-8498486aa553 req-8bccb52e-8dd8-4b0f-bad2-2abe3ad5d585 service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-deleted-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:19:01 user nova-compute[72520]: WARNING nova.volume.cinder [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Attachment be50a978-73e1-4746-ab4b-499e4e65b31a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = be50a978-73e1-4746-ab4b-499e4e65b31a. (HTTP 404) (Request-ID: req-432b4749-0fad-4d7c-95b5-da16ef2b8ae7)
Aug 03 00:19:01 user nova-compute[72520]: INFO nova.compute.manager [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Took 0.03 seconds to detach 1 volumes for instance.
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:01 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Deleted allocations for instance 0f326817-86f3-4c49-b78c-6329dee8eb87
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d9dc92ca-fd82-4116-8bf2-cd72d1bf518b tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:19:01 user nova-compute[72520]: WARNING nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received unexpected event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with vm_state deleted and task_state None.
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:19:01 user nova-compute[72520]: WARNING nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received unexpected event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with vm_state deleted and task_state None.
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:19:01 user nova-compute[72520]: WARNING nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received unexpected event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with vm_state deleted and task_state None.
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-unplugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-unplugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:19:01 user nova-compute[72520]: WARNING nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received unexpected event network-vif-unplugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with vm_state deleted and task_state None.
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Acquiring lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] Lock "0f326817-86f3-4c49-b78c-6329dee8eb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:01 user nova-compute[72520]: DEBUG nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] No waiting events found dispatching network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:19:01 user nova-compute[72520]: WARNING nova.compute.manager [req-3cd91eb3-9fb2-4712-8755-a45a52b9a920 req-7a0bc5e6-4fb5-426d-a4e4-0aa3f6e25d0c service nova] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Received unexpected event network-vif-plugged-ba44a6a0-de4f-4594-8c03-80ccfbd2edca for instance with vm_state deleted and task_state None.
Aug 03 00:19:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:19:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:15 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691021940.199179, 0f326817-86f3-4c49-b78c-6329dee8eb87 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:19:15 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] VM Stopped (Lifecycle Event)
Aug 03 00:19:15 user nova-compute[72520]: DEBUG nova.compute.manager [None req-80b9d1bc-9927-4fae-b001-bfcbff5d697e None None] [instance: 0f326817-86f3-4c49-b78c-6329dee8eb87] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:19:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:19 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:19:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:19:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 00:19:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:19:25 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:19:25 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:19:25 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=25.237342834472656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:19:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:19:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:19:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:19:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:19:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:19:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:19:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:19:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:19:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:20:10 user nova-compute[72520]: INFO nova.compute.claims [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Claim successful on node user
Aug 03 00:20:10 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:20:10 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:20:11 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.policy [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48c32aebdc4c4b328ea62e01c07183aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c3ec307a934b0bb75dba746db16fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:20:11 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Creating image(s)
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "/opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "/opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.162s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk 1073741824" returned: 0 in 0.053s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Successfully created port: aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Cannot resize image /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'migration_context' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Ensure instance console log exists: /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Successfully updated port: aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquired lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-changed-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Refreshing instance network info cache due to event network-changed-aa5b9e26-774c-402b-bd59-35756f64640c. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] Acquiring lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.network.neutron [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating instance_info_cache with network_info: [{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Releasing lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Instance network_info: |[{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] Acquired lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.network.neutron [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Refreshing network info cache for port aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Start _get_guest_xml network_info=[{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:20:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:20:12 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:20:12 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-540637001',display_name='tempest-VolumesSnapshotTestJSON-instance-540637001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-540637001',id=51,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKf2J/dw1EWswSoYwYhh7nxlkuq8dwqW5BRaSY8ti+f5PHtEozb/iORrwC3za01pyGobJzYLojAZfi0Gohx4uQr9bc+sqen6Ckr4ehZhBbUTGLdkY7vNiZprKXvOeS6vA==',key_name='tempest-keypair-75106236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c3ec307a934b0bb75dba746db16fd6',ramdisk_id='',reservation_id='r-jxqlp1kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1802936978',owner_user_name='tempest-VolumesSnapshotTestJSON-1802936978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c32aebdc4c4b328ea62e01c07183aa',uuid=a7c29209-26f4-4633-b852-7cf912d32f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converting VIF {"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=aa5b9e26-774c-402b-bd59-35756f64640c,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b9e26-77') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'pci_devices' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:20:13 user nova-compute[72520]:   <uuid>a7c29209-26f4-4633-b852-7cf912d32f06</uuid>
Aug 03 00:20:13 user nova-compute[72520]:   <name>instance-00000033</name>
Aug 03 00:20:13 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:20:13 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:20:13 user nova-compute[72520]:   <metadata>
Aug 03 00:20:13 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:20:13 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:20:13 user nova-compute[72520]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-540637001</nova:name>
Aug 03 00:20:13 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:20:12</nova:creationTime>
Aug 03 00:20:13 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:20:13 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:20:13 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:20:13 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:20:13 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:20:13 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:20:13 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:20:13 user nova-compute[72520]:       <nova:owner>
Aug 03 00:20:13 user nova-compute[72520]:         <nova:user uuid="48c32aebdc4c4b328ea62e01c07183aa">tempest-VolumesSnapshotTestJSON-1802936978-project-member</nova:user>
Aug 03 00:20:13 user nova-compute[72520]:         <nova:project uuid="d5c3ec307a934b0bb75dba746db16fd6">tempest-VolumesSnapshotTestJSON-1802936978</nova:project>
Aug 03 00:20:13 user nova-compute[72520]:       </nova:owner>
Aug 03 00:20:13 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:20:13 user nova-compute[72520]:       <nova:ports>
Aug 03 00:20:13 user nova-compute[72520]:         <nova:port uuid="aa5b9e26-774c-402b-bd59-35756f64640c">
Aug 03 00:20:13 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 03 00:20:13 user nova-compute[72520]:         </nova:port>
Aug 03 00:20:13 user nova-compute[72520]:       </nova:ports>
Aug 03 00:20:13 user nova-compute[72520]:     </nova:instance>
Aug 03 00:20:13 user nova-compute[72520]:   </metadata>
Aug 03 00:20:13 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:20:13 user nova-compute[72520]:     <system>
Aug 03 00:20:13 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:20:13 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:20:13 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:20:13 user nova-compute[72520]:       <entry name="serial">a7c29209-26f4-4633-b852-7cf912d32f06</entry>
Aug 03 00:20:13 user nova-compute[72520]:       <entry name="uuid">a7c29209-26f4-4633-b852-7cf912d32f06</entry>
Aug 03 00:20:13 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:20:13 user nova-compute[72520]:     </system>
Aug 03 00:20:13 user nova-compute[72520]:   </sysinfo>
Aug 03 00:20:13 user nova-compute[72520]:   <os>
Aug 03 00:20:13 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:20:13 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:20:13 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:20:13 user nova-compute[72520]:   </os>
Aug 03 00:20:13 user nova-compute[72520]:   <features>
Aug 03 00:20:13 user nova-compute[72520]:     <acpi/>
Aug 03 00:20:13 user nova-compute[72520]:     <apic/>
Aug 03 00:20:13 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:20:13 user nova-compute[72520]:   </features>
Aug 03 00:20:13 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:20:13 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:20:13 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:20:13 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:20:13 user nova-compute[72520]:   </clock>
Aug 03 00:20:13 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:20:13 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:20:13 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:20:13 user nova-compute[72520]:   </cpu>
Aug 03 00:20:13 user nova-compute[72520]:   <devices>
Aug 03 00:20:13 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:20:13 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:20:13 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk"/>
Aug 03 00:20:13 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:20:13 user nova-compute[72520]:     </disk>
Aug 03 00:20:13 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:20:13 user nova-compute[72520]:       <mac address="fa:16:3e:11:30:2a"/>
Aug 03 00:20:13 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:20:13 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:20:13 user nova-compute[72520]:       <target dev="tapaa5b9e26-77"/>
Aug 03 00:20:13 user nova-compute[72520]:     </interface>
Aug 03 00:20:13 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:20:13 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/console.log" append="off"/>
Aug 03 00:20:13 user nova-compute[72520]:     </serial>
Aug 03 00:20:13 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:20:13 user nova-compute[72520]:     <video>
Aug 03 00:20:13 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:20:13 user nova-compute[72520]:     </video>
Aug 03 00:20:13 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:20:13 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:20:13 user nova-compute[72520]:     </rng>
Aug 03 00:20:13 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:20:13 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:20:13 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:20:13 user nova-compute[72520]:     </memballoon>
Aug 03 00:20:13 user nova-compute[72520]:   </devices>
Aug 03 00:20:13 user nova-compute[72520]: </domain>
Aug 03 00:20:13 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-540637001',display_name='tempest-VolumesSnapshotTestJSON-instance-540637001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-540637001',id=51,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKf2J/dw1EWswSoYwYhh7nxlkuq8dwqW5BRaSY8ti+f5PHtEozb/iORrwC3za01pyGobJzYLojAZfi0Gohx4uQr9bc+sqen6Ckr4ehZhBbUTGLdkY7vNiZprKXvOeS6vA==',key_name='tempest-keypair-75106236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c3ec307a934b0bb75dba746db16fd6',ramdisk_id='',reservation_id='r-jxqlp1kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1802936978',owner_user_name='tempest-VolumesSnapshotTestJSON-1802936978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c32aebdc4c4b328ea62e01c07183aa',uuid=a7c29209-26f4-4633-b852-7cf912d32f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converting VIF {"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=aa5b9e26-774c-402b-bd59-35756f64640c,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b9e26-77') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG os_vif [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=aa5b9e26-774c-402b-bd59-35756f64640c,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b9e26-77') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa5b9e26-77, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa5b9e26-77, col_values=(('external_ids', {'iface-id': 'aa5b9e26-774c-402b-bd59-35756f64640c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:30:2a', 'vm-uuid': 'a7c29209-26f4-4633-b852-7cf912d32f06'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:13 user nova-compute[72520]: INFO os_vif [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=aa5b9e26-774c-402b-bd59-35756f64640c,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b9e26-77')
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No VIF found with MAC fa:16:3e:11:30:2a, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updated VIF entry in instance network info cache for port aa5b9e26-774c-402b-bd59-35756f64640c. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG nova.network.neutron [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating instance_info_cache with network_info: [{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:20:13 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-a2718ae4-2d93-41f4-86af-083906c10365 req-838d45ed-6730-4590-b05f-52d11f59a963 service nova] Releasing lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-bb303669-869a-4b07-912e-af0161edf06c req-78fa2f88-05a7-4667-8887-a11300a90ad8 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bb303669-869a-4b07-912e-af0161edf06c req-78fa2f88-05a7-4667-8887-a11300a90ad8 service nova] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bb303669-869a-4b07-912e-af0161edf06c req-78fa2f88-05a7-4667-8887-a11300a90ad8 service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-bb303669-869a-4b07-912e-af0161edf06c req-78fa2f88-05a7-4667-8887-a11300a90ad8 service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG nova.compute.manager [req-bb303669-869a-4b07-912e-af0161edf06c req-78fa2f88-05a7-4667-8887-a11300a90ad8 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] No waiting events found dispatching network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:20:14 user nova-compute[72520]: WARNING nova.compute.manager [req-bb303669-869a-4b07-912e-af0161edf06c req-78fa2f88-05a7-4667-8887-a11300a90ad8 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received unexpected event network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c for instance with vm_state building and task_state spawning.
Aug 03 00:20:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691022016.491971, a7c29209-26f4-4633-b852-7cf912d32f06 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:20:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] VM Resumed (Lifecycle Event)
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:20:16 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Instance spawned successfully.
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:20:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691022016.4936423, a7c29209-26f4-4633-b852-7cf912d32f06 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:20:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] VM Started (Lifecycle Event)
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:20:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:20:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:20:16 user nova-compute[72520]: INFO nova.compute.manager [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Took 5.96 seconds to build instance.
Aug 03 00:20:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d1730511-c475-4a0b-b392-0548125a8026 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.057s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-22818dd4-1c5b-4d9e-ae1c-2ea0b86c0d00 req-bc82d01f-d880-4264-add9-3f5b55bce37d service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-22818dd4-1c5b-4d9e-ae1c-2ea0b86c0d00 req-bc82d01f-d880-4264-add9-3f5b55bce37d service nova] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-22818dd4-1c5b-4d9e-ae1c-2ea0b86c0d00 req-bc82d01f-d880-4264-add9-3f5b55bce37d service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-22818dd4-1c5b-4d9e-ae1c-2ea0b86c0d00 req-bc82d01f-d880-4264-add9-3f5b55bce37d service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:16 user nova-compute[72520]: DEBUG nova.compute.manager [req-22818dd4-1c5b-4d9e-ae1c-2ea0b86c0d00 req-bc82d01f-d880-4264-add9-3f5b55bce37d service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] No waiting events found dispatching network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:20:16 user nova-compute[72520]: WARNING nova.compute.manager [req-22818dd4-1c5b-4d9e-ae1c-2ea0b86c0d00 req-bc82d01f-d880-4264-add9-3f5b55bce37d service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received unexpected event network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c for instance with vm_state active and task_state None.
Aug 03 00:20:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:21 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:20:21 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:20:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:20:21 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:20:21 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:20:21 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:20:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating instance_info_cache with network_info: [{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:20:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:20:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:20:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:20:25 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:20:26 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:20:26 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:20:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=25.235065460205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a7c29209-26f4-4633-b852-7cf912d32f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:20:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:20:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:20:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:20:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:20:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:20:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:20:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:20:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:21:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating instance_info_cache with network_info: [{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:21:22 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:21:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:21:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:21:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:21:27 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:21:27 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:21:27 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.20669174194336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a7c29209-26f4-4633-b852-7cf912d32f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:21:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:21:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:32 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:21:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:21:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:38 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:21:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:43 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:44 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:21:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:21:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:53 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:21:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:21:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:21:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:21:58 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-changed-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG nova.compute.manager [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Refreshing instance network info cache due to event network-changed-aa5b9e26-774c-402b-bd59-35756f64640c. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] Acquiring lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] Acquired lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG nova.network.neutron [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Refreshing network info cache for port aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'flavor' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:22:02 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Ignoring supplied device name: /dev/vdb
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:02 user nova-compute[72520]: INFO nova.compute.manager [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Attaching volume cc89c914-e81d-41f3-8e4e-0299f54173a7 to /dev/vdb
Aug 03 00:22:02 user nova-compute[72520]: DEBUG os_brick.utils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3201c0-8224-488f-ae4c-9e0de0061805]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1baedcf-f869-440a-ae7a-d658a8847df3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8484502-6bcf-4029-8ad6-f217fe9285d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa4c351-3de2-4c5a-9d5b-045efd0bd0e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:22:02 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27005b99-c87d-4b4a-bc9b-e36b41dbcf72]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG os_brick.utils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating existing volume attachment record: c03bdbca-6671-4199-afac-f48b7186ee10 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG nova.network.neutron [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updated VIF entry in instance network info cache for port aa5b9e26-774c-402b-bd59-35756f64640c. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG nova.network.neutron [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating instance_info_cache with network_info: [{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:22:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-d309a954-42a6-4f1f-b68f-d35cfcdaffc9 req-912dc566-ae0f-4d60-bf55-91b1e81f9d59 service nova] Releasing lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:22:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:22:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:08 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GristxXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:22:10 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:22:10 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:22:10 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d103ef-968a-42d3-abc4-ee1fe50820e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:22:10 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21ea038-295b-454e-894d-f0af1836c0da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7] added
Aug 03 00:22:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bdfc87-5041-49bc-9e65-9d5e8b1864c3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef149789-1d82-44c8-b466-6b82b2f29473]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GristxXH {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GristxXH" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dbace5-60dd-4449-a85e-77e81c5984f6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GristxXH'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe43c0-4b4b-4095-9fea-7a16e600dca5]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[24633925-aee0-4c1e-ba61-0e22334f3772]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:22:10 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:22:10 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:22:10 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:22:10 user nova-compute[72520]: 
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb1297d-588a-4748-8016-0cc0eb639806]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260]
Aug 03 00:22:10 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260] successful.
Aug 03 00:22:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2196e7-00a1-4e9f-b155-982534cb9a80]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c444925-e047-4832-9a0e-ecc3b9bb8caf]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 (non-flash)
Aug 03 00:22:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 (non-flash)
Aug 03 00:22:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bccd93-35af-422d-bed7-1eccc12a0805]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:22:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GristxXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23638356665376135', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638356665376135', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'flavor' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:22:11 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:22:11 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:22:11 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:22:11 user nova-compute[72520]:   <serial>cc89c914-e81d-41f3-8e4e-0299f54173a7</serial>
Aug 03 00:22:11 user nova-compute[72520]: </disk>
Aug 03 00:22:11 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] No VIF found with MAC fa:16:3e:11:30:2a, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:22:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-08e53e7b-bf5f-4916-b99d-fb37677feac7 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.389s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:13 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:18 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:22:23 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:22:24 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating instance_info_cache with network_info: [{"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:22:24 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-a7c29209-26f4-4633-b852-7cf912d32f06" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:22:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:22:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:27 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:28 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:22:28 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:22:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.20562744140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance a7c29209-26f4-4633-b852-7cf912d32f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:22:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:31 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 00:22:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:32 user nova-compute[72520]: INFO nova.compute.manager [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Detaching volume cc89c914-e81d-41f3-8e4e-0299f54173a7
Aug 03 00:22:32 user nova-compute[72520]: INFO nova.virt.block_device [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Attempting to driver detach volume cc89c914-e81d-41f3-8e4e-0299f54173a7 from mountpoint /dev/vdb
Aug 03 00:22:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Attempting to detach device vdb from instance a7c29209-26f4-4633-b852-7cf912d32f06 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:22:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:22:32 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:22:32 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:22:32 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:22:32 user nova-compute[72520]:   <serial>cc89c914-e81d-41f3-8e4e-0299f54173a7</serial>
Aug 03 00:22:32 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:22:32 user nova-compute[72520]: </disk>
Aug 03 00:22:32 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:22:32 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully detached device vdb from instance a7c29209-26f4-4633-b852-7cf912d32f06 from the persistent domain config.
Aug 03 00:22:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7c29209-26f4-4633-b852-7cf912d32f06 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:22:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:22:32 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:22:32 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:22:32 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:22:32 user nova-compute[72520]:   <serial>cc89c914-e81d-41f3-8e4e-0299f54173a7</serial>
Aug 03 00:22:32 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:22:32 user nova-compute[72520]: </disk>
Aug 03 00:22:32 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:22:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691022153.1843634, a7c29209-26f4-4633-b852-7cf912d32f06 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:22:33 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully detached device vdb from instance a7c29209-26f4-4633-b852-7cf912d32f06 from the live domain config.
Aug 03 00:22:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GristxXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:22:33 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e826d-70fd-4a6f-8378-8b0d11205e50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fb9fb0-b5c7-477e-86e5-4dcd212eeed6]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 (non-flash)
Aug 03 00:22:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 (non-flash)
Aug 03 00:22:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4233760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5a91e6-7696-4f4b-a8c0-09438e006220]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[438ced11-7bde-4233-b53f-98f5c7a5587b]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0089d9-1cae-44c3-ac78-484a9d4cee70]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5174366d-5f90-43c2-b3fd-fdaeec20f67a]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddda3df-77e3-4edc-8491-6ef84250c408]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e1c722-8add-4e30-8cfa-0f17651bca1e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260]
Aug 03 00:22:33 user nova-compute[72520]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7, portal: 172.16.0.220,3260] successful.
Aug 03 00:22:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4505b64-63f7-4b0d-afb0-d780505e8e42]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== disconnect_volume: return (321ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:22:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'flavor' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5825ca1a-2898-4451-ba93-4eade47cc3c2 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.807s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.694s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:34 user nova-compute[72520]: INFO nova.compute.manager [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Terminating instance
Aug 03 00:22:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-13339906-a199-4902-aa75-5bc0be77f673 req-f0dc2e0c-950f-43a9-932a-97b77fb62850 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-vif-unplugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-13339906-a199-4902-aa75-5bc0be77f673 req-f0dc2e0c-950f-43a9-932a-97b77fb62850 service nova] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-13339906-a199-4902-aa75-5bc0be77f673 req-f0dc2e0c-950f-43a9-932a-97b77fb62850 service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-13339906-a199-4902-aa75-5bc0be77f673 req-f0dc2e0c-950f-43a9-932a-97b77fb62850 service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-13339906-a199-4902-aa75-5bc0be77f673 req-f0dc2e0c-950f-43a9-932a-97b77fb62850 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] No waiting events found dispatching network-vif-unplugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG nova.compute.manager [req-13339906-a199-4902-aa75-5bc0be77f673 req-f0dc2e0c-950f-43a9-932a-97b77fb62850 service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-vif-unplugged-aa5b9e26-774c-402b-bd59-35756f64640c for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Instance destroyed successfully.
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.objects.instance [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lazy-loading 'resources' on Instance uuid a7c29209-26f4-4633-b852-7cf912d32f06 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-540637001',display_name='tempest-VolumesSnapshotTestJSON-instance-540637001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-540637001',id=51,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKf2J/dw1EWswSoYwYhh7nxlkuq8dwqW5BRaSY8ti+f5PHtEozb/iORrwC3za01pyGobJzYLojAZfi0Gohx4uQr9bc+sqen6Ckr4ehZhBbUTGLdkY7vNiZprKXvOeS6vA==',key_name='tempest-keypair-75106236',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:20:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c3ec307a934b0bb75dba746db16fd6',ramdisk_id='',reservation_id='r-jxqlp1kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1802936978',owner_user_name='tempest-VolumesSnapshotTestJSON-1802936978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c32aebdc4c4b328ea62e01c07183aa',uuid=a7c29209-26f4-4633-b852-7cf912d32f06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converting VIF {"id": "aa5b9e26-774c-402b-bd59-35756f64640c", "address": "fa:16:3e:11:30:2a", "network": {"id": "760bd1c9-e0b9-4ea5-80f9-45f4293bc096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2105870597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c3ec307a934b0bb75dba746db16fd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b9e26-77", "ovs_interfaceid": "aa5b9e26-774c-402b-bd59-35756f64640c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=aa5b9e26-774c-402b-bd59-35756f64640c,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b9e26-77') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_vif [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=aa5b9e26-774c-402b-bd59-35756f64640c,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b9e26-77') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa5b9e26-77, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:22:35 user nova-compute[72520]: INFO os_vif [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=aa5b9e26-774c-402b-bd59-35756f64640c,network=Network(760bd1c9-e0b9-4ea5-80f9-45f4293bc096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b9e26-77')
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GristxXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:22:35 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc89c914-e81d-41f3-8e4e-0299f54173a7', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bd2c18-104a-444f-a06a-10dd01ccb1d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:35 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 03 00:22:35 user nova-compute[72520]: 
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d07e25-c794-432c-ae57-aa5d47930833]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:22:35 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:22:35 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:22:35 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:22:35 user nova-compute[72520]: 
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4653520>, {}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Disconnecting from: [] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.042s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] <== disconnect_volume: return (43ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:22:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Deleting instance files /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06_del
Aug 03 00:22:35 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Deletion of /opt/stack/data/nova/instances/a7c29209-26f4-4633-b852-7cf912d32f06_del complete
Aug 03 00:22:35 user nova-compute[72520]: INFO nova.compute.manager [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 03 00:22:35 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:22:35 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 00:22:36 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Took 0.89 seconds to deallocate network for instance.
Aug 03 00:22:36 user nova-compute[72520]: WARNING nova.volume.cinder [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Attachment c03bdbca-6671-4199-afac-f48b7186ee10 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c03bdbca-6671-4199-afac-f48b7186ee10. (HTTP 404) (Request-ID: req-fba94d98-d067-4a49-8b48-208a1c4dfab4)
Aug 03 00:22:36 user nova-compute[72520]: INFO nova.compute.manager [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Took 0.03 seconds to detach 1 volumes for instance.
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-ba0b6db4-d245-47ed-8192-ac9b4a5c6447 req-d5d96a80-d1d5-4766-836b-28a30e0b36ee service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ba0b6db4-d245-47ed-8192-ac9b4a5c6447 req-d5d96a80-d1d5-4766-836b-28a30e0b36ee service nova] Acquiring lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ba0b6db4-d245-47ed-8192-ac9b4a5c6447 req-d5d96a80-d1d5-4766-836b-28a30e0b36ee service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-ba0b6db4-d245-47ed-8192-ac9b4a5c6447 req-d5d96a80-d1d5-4766-836b-28a30e0b36ee service nova] Lock "a7c29209-26f4-4633-b852-7cf912d32f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-ba0b6db4-d245-47ed-8192-ac9b4a5c6447 req-d5d96a80-d1d5-4766-836b-28a30e0b36ee service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] No waiting events found dispatching network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:22:36 user nova-compute[72520]: WARNING nova.compute.manager [req-ba0b6db4-d245-47ed-8192-ac9b4a5c6447 req-d5d96a80-d1d5-4766-836b-28a30e0b36ee service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received unexpected event network-vif-plugged-aa5b9e26-774c-402b-bd59-35756f64640c for instance with vm_state deleted and task_state None.
Aug 03 00:22:36 user nova-compute[72520]: DEBUG nova.compute.manager [req-ba0b6db4-d245-47ed-8192-ac9b4a5c6447 req-d5d96a80-d1d5-4766-836b-28a30e0b36ee service nova] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Received event network-vif-deleted-aa5b9e26-774c-402b-bd59-35756f64640c {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:36 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Deleted allocations for instance a7c29209-26f4-4633-b852-7cf912d32f06
Aug 03 00:22:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-98561bab-6d49-4b47-8bee-1d3dcdab8044 tempest-VolumesSnapshotTestJSON-1802936978 tempest-VolumesSnapshotTestJSON-1802936978-project-member] Lock "a7c29209-26f4-4633-b852-7cf912d32f06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:22:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:22:50 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691022155.3058383, a7c29209-26f4-4633-b852-7cf912d32f06 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:22:50 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] VM Stopped (Lifecycle Event)
Aug 03 00:22:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-0894ee9e-e55c-4056-9dd4-8de31930921b None None] [instance: a7c29209-26f4-4633-b852-7cf912d32f06] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:22:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:22:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:22:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:22:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:22:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:22:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:23:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:23:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:23:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:23 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:23:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:23:24 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 00:23:24 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:23:28 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:23:28 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:23:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.232433319091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 00:23:28 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 00:23:29 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 00:23:29 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 00:23:29 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:23:29 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:23:29 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:23:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:23:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:35 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:23:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:23:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:23:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:23:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:23:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:23:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:23:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:24:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:21 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:26 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:24:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:24:26 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:24:29 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:24:29 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:24:29 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.226322174072266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:24:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:24:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:24:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:24:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:24:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:24:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:36 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:36 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:24:37 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:24:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:24:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:24:48 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:51 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:56 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:24:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Starting instance... {{(pid=72520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 00:25:06 user nova-compute[72520]: INFO nova.compute.claims [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Claim successful on node user
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Start building networks asynchronously for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Allocating IP information in the background. {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.network.neutron [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] allocate_for_instance() {{(pid=72520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 00:25:06 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Start building block device mappings for instance. {{(pid=72520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 00:25:06 user nova-compute[72520]: DEBUG nova.policy [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f14b402fa25447279bf7b15edb2cb9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fcd7fc11344b96a8ea5fe4447818f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Start spawning the instance on the hypervisor. {{(pid=72520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Creating instance directory {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 00:25:07 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Creating image(s)
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "/opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "/opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "/opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.165s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.149s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk 1073741824 {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab,backing_fmt=raw /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk 1073741824" returned: 0 in 0.056s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "6249d67cc86a3a000c7773ff7eabaedf3366a3ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6249d67cc86a3a000c7773ff7eabaedf3366a3ab --force-share --output=json" returned: 0 in 0.145s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk. size=1073741824 {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.network.neutron [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Successfully created port: e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.virt.disk.api [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Cannot resize image /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk to a smaller size. {{(pid=72520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.objects.instance [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'migration_context' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Created local disks {{(pid=72520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Ensure instance console log exists: /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/console.log {{(pid=72520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:07 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:08 user nova-compute[72520]: DEBUG nova.network.neutron [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Successfully updated port: e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Building network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Instance cache missing network info. {{(pid=72520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.network.neutron [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Instance network_info: |[{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Start _get_guest_xml network_info=[{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_options': None, 'size': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'bf7ff550-99bb-492f-8b9b-e7b427d12188'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 00:25:09 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:25:09 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CPU controller missing on host. {{(pid=72520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.host [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CPU controller found on host. {{(pid=72520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-02T23:26:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-02T23:27:05Z,direct_url=<?>,disk_format='qcow2',id=bf7ff550-99bb-492f-8b9b-e7b427d12188,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9cf09fb1019e43f589f82d1ed506d2a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-02T23:27:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Flavor limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Image limits 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Flavor pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Image pref 0:0:0 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Got 1 possible topologies {{(pid=72520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.hardware [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-701203765',display_name='tempest-SnapshotDataIntegrityTests-server-701203765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-701203765',id=52,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyo5P6Vir1mceGl+iXqNxBKRP46lFnB4XiLbsY5JZ2Sj+N8ITBE3QdSaJD+g9Dpaz0duwycOUEX4aC4syXjTIvL8d4vNgWdvnw0ZyAOzuPnvokCk+vkRbxND9nnQCKoyg==',key_name='tempest-keypair-1031433737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8fcd7fc11344b96a8ea5fe4447818f3',ramdisk_id='',reservation_id='r-mrpmcno0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-241679260',owner_user_name='tempest-SnapshotDataIntegrityTests-241679260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f14b402fa25447279bf7b15edb2cb9f9',uuid=22b8e2a6-590c-4443-b51e-ba8958a9dfd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Converting VIF {"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:b5,bridge_name='br-int',has_traffic_filtering=True,id=e8335ea8-52b6-4513-9b65-8228034156c4,network=Network(c1817d99-d12f-4519-80b6-4bfe72329af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8335ea8-52') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.objects.instance [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] End _get_guest_xml xml=<domain type="kvm">
Aug 03 00:25:09 user nova-compute[72520]:   <uuid>22b8e2a6-590c-4443-b51e-ba8958a9dfd7</uuid>
Aug 03 00:25:09 user nova-compute[72520]:   <name>instance-00000034</name>
Aug 03 00:25:09 user nova-compute[72520]:   <memory>524288</memory>
Aug 03 00:25:09 user nova-compute[72520]:   <vcpu>1</vcpu>
Aug 03 00:25:09 user nova-compute[72520]:   <metadata>
Aug 03 00:25:09 user nova-compute[72520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 00:25:09 user nova-compute[72520]:       <nova:package version="0.0.0"/>
Aug 03 00:25:09 user nova-compute[72520]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-701203765</nova:name>
Aug 03 00:25:09 user nova-compute[72520]:       <nova:creationTime>2023-08-03 00:25:09</nova:creationTime>
Aug 03 00:25:09 user nova-compute[72520]:       <nova:flavor name="m1.tiny">
Aug 03 00:25:09 user nova-compute[72520]:         <nova:memory>512</nova:memory>
Aug 03 00:25:09 user nova-compute[72520]:         <nova:disk>1</nova:disk>
Aug 03 00:25:09 user nova-compute[72520]:         <nova:swap>0</nova:swap>
Aug 03 00:25:09 user nova-compute[72520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 00:25:09 user nova-compute[72520]:         <nova:vcpus>1</nova:vcpus>
Aug 03 00:25:09 user nova-compute[72520]:       </nova:flavor>
Aug 03 00:25:09 user nova-compute[72520]:       <nova:owner>
Aug 03 00:25:09 user nova-compute[72520]:         <nova:user uuid="f14b402fa25447279bf7b15edb2cb9f9">tempest-SnapshotDataIntegrityTests-241679260-project-member</nova:user>
Aug 03 00:25:09 user nova-compute[72520]:         <nova:project uuid="b8fcd7fc11344b96a8ea5fe4447818f3">tempest-SnapshotDataIntegrityTests-241679260</nova:project>
Aug 03 00:25:09 user nova-compute[72520]:       </nova:owner>
Aug 03 00:25:09 user nova-compute[72520]:       <nova:root type="image" uuid="bf7ff550-99bb-492f-8b9b-e7b427d12188"/>
Aug 03 00:25:09 user nova-compute[72520]:       <nova:ports>
Aug 03 00:25:09 user nova-compute[72520]:         <nova:port uuid="e8335ea8-52b6-4513-9b65-8228034156c4">
Aug 03 00:25:09 user nova-compute[72520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 00:25:09 user nova-compute[72520]:         </nova:port>
Aug 03 00:25:09 user nova-compute[72520]:       </nova:ports>
Aug 03 00:25:09 user nova-compute[72520]:     </nova:instance>
Aug 03 00:25:09 user nova-compute[72520]:   </metadata>
Aug 03 00:25:09 user nova-compute[72520]:   <sysinfo type="smbios">
Aug 03 00:25:09 user nova-compute[72520]:     <system>
Aug 03 00:25:09 user nova-compute[72520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 00:25:09 user nova-compute[72520]:       <entry name="product">OpenStack Nova</entry>
Aug 03 00:25:09 user nova-compute[72520]:       <entry name="version">0.0.0</entry>
Aug 03 00:25:09 user nova-compute[72520]:       <entry name="serial">22b8e2a6-590c-4443-b51e-ba8958a9dfd7</entry>
Aug 03 00:25:09 user nova-compute[72520]:       <entry name="uuid">22b8e2a6-590c-4443-b51e-ba8958a9dfd7</entry>
Aug 03 00:25:09 user nova-compute[72520]:       <entry name="family">Virtual Machine</entry>
Aug 03 00:25:09 user nova-compute[72520]:     </system>
Aug 03 00:25:09 user nova-compute[72520]:   </sysinfo>
Aug 03 00:25:09 user nova-compute[72520]:   <os>
Aug 03 00:25:09 user nova-compute[72520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 00:25:09 user nova-compute[72520]:     <boot dev="hd"/>
Aug 03 00:25:09 user nova-compute[72520]:     <smbios mode="sysinfo"/>
Aug 03 00:25:09 user nova-compute[72520]:   </os>
Aug 03 00:25:09 user nova-compute[72520]:   <features>
Aug 03 00:25:09 user nova-compute[72520]:     <acpi/>
Aug 03 00:25:09 user nova-compute[72520]:     <apic/>
Aug 03 00:25:09 user nova-compute[72520]:     <vmcoreinfo/>
Aug 03 00:25:09 user nova-compute[72520]:   </features>
Aug 03 00:25:09 user nova-compute[72520]:   <clock offset="utc">
Aug 03 00:25:09 user nova-compute[72520]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 00:25:09 user nova-compute[72520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 00:25:09 user nova-compute[72520]:     <timer name="hpet" present="no"/>
Aug 03 00:25:09 user nova-compute[72520]:   </clock>
Aug 03 00:25:09 user nova-compute[72520]:   <cpu mode="custom" match="exact">
Aug 03 00:25:09 user nova-compute[72520]:     <model>Nehalem</model>
Aug 03 00:25:09 user nova-compute[72520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 00:25:09 user nova-compute[72520]:   </cpu>
Aug 03 00:25:09 user nova-compute[72520]:   <devices>
Aug 03 00:25:09 user nova-compute[72520]:     <disk type="file" device="disk">
Aug 03 00:25:09 user nova-compute[72520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 00:25:09 user nova-compute[72520]:       <source file="/opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk"/>
Aug 03 00:25:09 user nova-compute[72520]:       <target dev="vda" bus="virtio"/>
Aug 03 00:25:09 user nova-compute[72520]:     </disk>
Aug 03 00:25:09 user nova-compute[72520]:     <interface type="ethernet">
Aug 03 00:25:09 user nova-compute[72520]:       <mac address="fa:16:3e:6b:96:b5"/>
Aug 03 00:25:09 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:25:09 user nova-compute[72520]:       <mtu size="1442"/>
Aug 03 00:25:09 user nova-compute[72520]:       <target dev="tape8335ea8-52"/>
Aug 03 00:25:09 user nova-compute[72520]:     </interface>
Aug 03 00:25:09 user nova-compute[72520]:     <serial type="pty">
Aug 03 00:25:09 user nova-compute[72520]:       <log file="/opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/console.log" append="off"/>
Aug 03 00:25:09 user nova-compute[72520]:     </serial>
Aug 03 00:25:09 user nova-compute[72520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 00:25:09 user nova-compute[72520]:     <video>
Aug 03 00:25:09 user nova-compute[72520]:       <model type="virtio"/>
Aug 03 00:25:09 user nova-compute[72520]:     </video>
Aug 03 00:25:09 user nova-compute[72520]:     <rng model="virtio">
Aug 03 00:25:09 user nova-compute[72520]:       <backend model="random">/dev/urandom</backend>
Aug 03 00:25:09 user nova-compute[72520]:     </rng>
Aug 03 00:25:09 user nova-compute[72520]:     <controller type="usb" index="0" model="none"/>
Aug 03 00:25:09 user nova-compute[72520]:     <memballoon model="virtio">
Aug 03 00:25:09 user nova-compute[72520]:       <stats period="10"/>
Aug 03 00:25:09 user nova-compute[72520]:     </memballoon>
Aug 03 00:25:09 user nova-compute[72520]:   </devices>
Aug 03 00:25:09 user nova-compute[72520]: </domain>
Aug 03 00:25:09 user nova-compute[72520]:  {{(pid=72520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-701203765',display_name='tempest-SnapshotDataIntegrityTests-server-701203765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-701203765',id=52,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyo5P6Vir1mceGl+iXqNxBKRP46lFnB4XiLbsY5JZ2Sj+N8ITBE3QdSaJD+g9Dpaz0duwycOUEX4aC4syXjTIvL8d4vNgWdvnw0ZyAOzuPnvokCk+vkRbxND9nnQCKoyg==',key_name='tempest-keypair-1031433737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8fcd7fc11344b96a8ea5fe4447818f3',ramdisk_id='',reservation_id='r-mrpmcno0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-241679260',owner_user_name='tempest-SnapshotDataIntegrityTests-241679260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T00:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f14b402fa25447279bf7b15edb2cb9f9',uuid=22b8e2a6-590c-4443-b51e-ba8958a9dfd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Converting VIF {"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:b5,bridge_name='br-int',has_traffic_filtering=True,id=e8335ea8-52b6-4513-9b65-8228034156c4,network=Network(c1817d99-d12f-4519-80b6-4bfe72329af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8335ea8-52') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG os_vif [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:b5,bridge_name='br-int',has_traffic_filtering=True,id=e8335ea8-52b6-4513-9b65-8228034156c4,network=Network(c1817d99-d12f-4519-80b6-4bfe72329af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8335ea8-52') {{(pid=72520) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8335ea8-52, may_exist=True, interface_attrs={}) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8335ea8-52, col_values=(('external_ids', {'iface-id': 'e8335ea8-52b6-4513-9b65-8228034156c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:96:b5', 'vm-uuid': '22b8e2a6-590c-4443-b51e-ba8958a9dfd7'}),), if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:09 user nova-compute[72520]: INFO os_vif [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:b5,bridge_name='br-int',has_traffic_filtering=True,id=e8335ea8-52b6-4513-9b65-8228034156c4,network=Network(c1817d99-d12f-4519-80b6-4bfe72329af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8335ea8-52')
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:25:09 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No VIF found with MAC fa:16:3e:6b:96:b5, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-changed-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG nova.compute.manager [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Refreshing instance network info cache due to event network-changed-e8335ea8-52b6-4513-9b65-8228034156c4. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG nova.network.neutron [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Refreshing network info cache for port e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG nova.network.neutron [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated VIF entry in instance network info cache for port e8335ea8-52b6-4513-9b65-8228034156c4. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG nova.network.neutron [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:25:10 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-62318ae3-bb21-464e-beca-842a4385ddb2 req-be60420a-13c9-4d0d-a7bb-9a7ec9a88588 service nova] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:25:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:11 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] No waiting events found dispatching network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:25:12 user nova-compute[72520]: WARNING nova.compute.manager [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received unexpected event network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 for instance with vm_state building and task_state spawning.
Aug 03 00:25:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] No waiting events found dispatching network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:25:12 user nova-compute[72520]: WARNING nova.compute.manager [req-6e2e615b-e68f-453c-a527-3c54f857c9cb req-03df40f9-5081-455b-a380-445c1e96265c service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received unexpected event network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 for instance with vm_state building and task_state spawning.
Aug 03 00:25:12 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691022313.8844197, 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 => Resumed> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:25:13 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] VM Resumed (Lifecycle Event)
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Instance event wait completed in 0 seconds for  {{(pid=72520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Guest created on hypervisor {{(pid=72520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 00:25:13 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Instance spawned successfully.
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Found default for hw_cdrom_bus of ide {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Found default for hw_disk_bus of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Found default for hw_input_bus of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Found default for hw_pointer_model of None {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Found default for hw_video_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Found default for hw_vif_model of virtio {{(pid=72520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 00:25:13 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.virt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Emitting event <LifecycleEvent: 1691022313.8860874, 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 => Started> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:25:13 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] VM Started (Lifecycle Event)
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:25:13 user nova-compute[72520]: DEBUG nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 00:25:14 user nova-compute[72520]: INFO nova.compute.manager [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 00:25:14 user nova-compute[72520]: INFO nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 03 00:25:14 user nova-compute[72520]: DEBUG nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:25:14 user nova-compute[72520]: INFO nova.compute.manager [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Took 7.92 seconds to build instance.
Aug 03 00:25:14 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-76942e0c-7b4d-47df-a5cb-cc999b511cb0 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.119s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:25:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:25:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:25:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:25:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:25:28 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:25:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:25:31 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:25:32 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:25:32 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:25:32 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8444MB free_disk=25.188602447509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:25:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:25:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:25:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:47 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:25:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:25:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:25 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:26:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:26:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:32 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:32 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:26:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:26:34 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:26:34 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:26:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.17681884765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:26:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:40 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:26:40 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:26:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:26:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-changed-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG nova.compute.manager [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Refreshing instance network info cache due to event network-changed-e8335ea8-52b6-4513-9b65-8228034156c4. {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Refreshing network info cache for port e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated VIF entry in instance network info cache for port e8335ea8-52b6-4513-9b65-8228034156c4. {{(pid=72520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG nova.network.neutron [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:26:57 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-1920218a-a4ed-42fb-840b-9a3a07fa80b4 req-32819b7b-5108-4199-8155-71e22b3e6494 service nova] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:26:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:26:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:27:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:27:02 user nova-compute[72520]: DEBUG nova.objects.instance [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:27:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:27:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:27:02 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:27:02 user nova-compute[72520]: INFO nova.compute.manager [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attaching volume d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f to /dev/vdb
Aug 03 00:27:03 user nova-compute[72520]: DEBUG os_brick.utils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fb82bd-56d5-4945-b744-5d111997c441]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5f953-a897-4d5f-b27a-08ad6432cc7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef6cc29-44d2-4cb7-a82c-0b5606e6b43b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29c740b-b582-408d-9e0c-0220763467b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:27:03 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:27:03 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e936e-0c56-4524-a7b6-c8091ebe00db]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG os_brick.utils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:27:03 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating existing volume attachment record: 1cc2f198-c753-486d-a6e5-04ac0d8328b9 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:27:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkyYzscr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:27:10 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:27:10 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:27:10 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2afdf3-68e8-45fe-8e8a-8390fc022e1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:27:10 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d3ca3c-d284-44bf-877c-bec98acaabdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f] added
Aug 03 00:27:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab445e-7edd-4a9e-9b7d-a7bf9ab7581d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[316dd4b5-de01-4a65-9014-1cb400a970c2]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkyYzscr {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkyYzscr" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7543bf8-c416-4118-9512-f106cc9c2c1b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkyYzscr'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8029af-5728-4f25-8e60-a591656421a1]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[166ba2d4-0127-45ef-b1c5-82bcec65c3c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:27:10 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:27:10 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:27:10 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:27:10 user nova-compute[72520]: 
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9393ca92-c32c-44b2-9f45-35001cd66474]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260]
Aug 03 00:27:10 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260] successful.
Aug 03 00:27:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6917a181-83ed-4ef5-8337-fe20ce6c2e4c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea2a128-7eb4-4e0b-bd61-26bd2da75024]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f (non-flash)
Aug 03 00:27:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f (non-flash)
Aug 03 00:27:10 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27e853-88f9-47a2-894c-05cc886d840b]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:10 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:27:11 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:27:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkyYzscr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:27:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:27:11 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23639343638366461', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:27:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639343638366461', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:27:11 user nova-compute[72520]: DEBUG nova.objects.instance [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:27:11 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:27:11 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:27:11 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:27:11 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:27:11 user nova-compute[72520]:   <serial>d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f</serial>
Aug 03 00:27:11 user nova-compute[72520]: </disk>
Aug 03 00:27:11 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:27:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:27:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:27:12 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No VIF found with MAC fa:16:3e:6b:96:b5, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:27:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-4f53de61-fda0-4955-a796-29edeb96be68 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.354s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:27:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:27:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:27 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:27:28 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:27:29 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:27:29 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:27:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:27:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:27:31 user nova-compute[72520]: INFO nova.compute.manager [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Detaching volume d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f
Aug 03 00:27:31 user nova-compute[72520]: INFO nova.virt.block_device [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attempting to driver detach volume d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f from mountpoint /dev/vdb
Aug 03 00:27:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Attempting to detach device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:27:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:27:31 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:27:31 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:27:31 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:27:31 user nova-compute[72520]:   <serial>d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f</serial>
Aug 03 00:27:31 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:27:31 user nova-compute[72520]: </disk>
Aug 03 00:27:31 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:27:31 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config.
Aug 03 00:27:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:27:31 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:27:31 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:27:31 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:27:31 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:27:31 user nova-compute[72520]:   <serial>d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f</serial>
Aug 03 00:27:31 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:27:31 user nova-compute[72520]: </disk>
Aug 03 00:27:31 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691022452.415061, 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:27:32 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config.
Aug 03 00:27:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkyYzscr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:27:32 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b891539-39fd-4db7-bb1a-3411157197e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f229c8-75ed-4d97-9653-df77f0be9b96]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f (non-flash)
Aug 03 00:27:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f (non-flash)
Aug 03 00:27:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d04e9bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6851bb-fe3e-47fd-9c80-41f8101e4cba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e4ebe8-04a8-42da-b5dc-a7b42e948417]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2a6663-8be1-4123-8bf1-9bed66b26e68]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cab76f-2738-49d0-992b-f89207ffb938]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e37efb-6825-4588-9d47-b3f01d552e9d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.194s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dab2202-82cd-493d-87b4-141f55eabcc5]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260]
Aug 03 00:27:32 user nova-compute[72520]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f, portal: 172.16.0.220,3260] successful.
Aug 03 00:27:32 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a32339-b0e4-4243-b6d6-0a1f1d52ec6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a539cb70-76f7-43ab-b2bc-d04aac7a80fd]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== disconnect_volume: return (400ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:27:32 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG nova.objects.instance [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3d04b2ae-dd99-4723-9f24-35e6fc8be859 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.772s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:27:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:27:34 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:27:34 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:27:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.175392150878906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:27:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:27:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:42 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:27:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:45 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:45 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 00:27:47 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:27:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 00:27:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 00:27:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:27:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:28:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:28:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:28:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:28:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:20 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:20 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Triggering sync for uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 00:28:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:28:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:28:20 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:28:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG nova.objects.instance [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:28:26 user nova-compute[72520]: INFO nova.compute.manager [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attaching volume 25915f40-5faf-4f43-accb-3cd16def02ac to /dev/vdb
Aug 03 00:28:26 user nova-compute[72520]: DEBUG os_brick.utils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[653fe455-ce0c-4000-8bee-7cd0fd9015a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93c99f8-0015-4c4f-9477-322c4c479a7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac16a1e-6951-4a50-a182-4ee53a5e47f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee05a3c-8671-44fe-b100-60f2af2b4261]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:28:26 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:28:26 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc77e03-0a0a-4ace-b657-1f2da8935333]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG os_brick.utils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:28:26 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating existing volume attachment record: 4f829b3b-eb64-4dfb-98f2-e0cffe2f2d3e {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:28:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:28:30 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:28:31 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChzgYSjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:28:33 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:28:33 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:28:33 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd1de98-f779-4dde-9e43-1ae03ad06475]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:28:33 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e897566d-116b-4a22-952d-b4357faf8e5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac] added
Aug 03 00:28:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b65803-1217-4dd9-a6a0-f5543166ca3c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85324a63-7d71-4405-882a-a9eca75e692d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChzgYSjI {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChzgYSjI" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab7c0cf-8bc1-4633-b6b5-f9537c4c2992]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChzgYSjI'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2628289-adb4-4bff-8f85-5e7bbb8e1d9c]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9193da8-92be-48a3-963e-be619887e4bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:28:33 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:28:33 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:28:33 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:28:33 user nova-compute[72520]: 
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68b3a18-378c-437e-b25b-f34659fd9119]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260]
Aug 03 00:28:33 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260] successful.
Aug 03 00:28:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91c6c4e-b4b8-45ec-94c8-de89252520b3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa573d04-9cdd-44d6-8190-61ba8ed48086]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac (non-flash)
Aug 03 00:28:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac (non-flash)
Aug 03 00:28:33 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f19408-4e0a-4396-8371-4522d6bcfba3]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:33 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:28:34 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:28:34 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.17464828491211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing inventories for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating ProviderTree inventory for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Updating inventory in ProviderTree for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing aggregate associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, aggregates: None {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Refreshing trait associations for resource provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI {{(pid=72520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChzgYSjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23431316531323466', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431316531323466', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:34 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:28:34 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:28:34 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:28:34 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:28:34 user nova-compute[72520]:   <serial>25915f40-5faf-4f43-accb-3cd16def02ac</serial>
Aug 03 00:28:34 user nova-compute[72520]: </disk>
Aug 03 00:28:34 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:28:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:28:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:28:35 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No VIF found with MAC fa:16:3e:6b:96:b5, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:28:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-3c49efa6-5960-447f-97fe-d3738d1a286b tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.174s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:28:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:28:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:28:37 user nova-compute[72520]: INFO nova.compute.manager [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Detaching volume 25915f40-5faf-4f43-accb-3cd16def02ac
Aug 03 00:28:37 user nova-compute[72520]: INFO nova.virt.block_device [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attempting to driver detach volume 25915f40-5faf-4f43-accb-3cd16def02ac from mountpoint /dev/vdb
Aug 03 00:28:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Attempting to detach device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:28:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:28:37 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:28:37 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:28:37 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:28:37 user nova-compute[72520]:   <serial>25915f40-5faf-4f43-accb-3cd16def02ac</serial>
Aug 03 00:28:37 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:28:37 user nova-compute[72520]: </disk>
Aug 03 00:28:37 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:28:37 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config.
Aug 03 00:28:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:28:37 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:28:37 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:28:37 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:28:37 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:28:37 user nova-compute[72520]:   <serial>25915f40-5faf-4f43-accb-3cd16def02ac</serial>
Aug 03 00:28:37 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:28:37 user nova-compute[72520]: </disk>
Aug 03 00:28:37 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691022518.3057559, 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:28:38 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config.
Aug 03 00:28:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChzgYSjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:28:38 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b677739-90fb-4615-9675-a2ccd3927900]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2611c067-4ee8-461e-b218-5cde4d1e440a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac (non-flash)
Aug 03 00:28:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac (non-flash)
Aug 03 00:28:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ce4233520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e77ee7-12c1-4486-be54-393b54841100]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75dea92-c42a-473c-9982-ecf72295fa74]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[923540b8-b062-4060-a390-61845646f471]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[463bf0ff-876c-4ec7-8d66-7900fb78bb96]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f67f8f-5d0f-4cd8-af9b-b27fcc4be0f6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5823266-284d-40e4-87d9-198e5ffc8437]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260]
Aug 03 00:28:38 user nova-compute[72520]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac, portal: 172.16.0.220,3260] successful.
Aug 03 00:28:38 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25915f40-5faf-4f43-accb-3cd16def02ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6647fb93-9a19-4a70-9b77-7013f8f6858d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== disconnect_volume: return (262ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:28:38 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:28:39 user nova-compute[72520]: DEBUG nova.objects.instance [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:28:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-134a2afb-edcf-4e33-b697-9143972e8adb tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.577s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:28:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:28:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:28:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:28:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:29:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:29:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:28 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:29:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:29:31 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:29:31 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:29:32 user nova-compute[72520]: INFO nova.compute.manager [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attaching volume c294a3eb-5d8c-4e90-99c1-a3e811136a0f to /dev/vdb
Aug 03 00:29:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4276824-bd6b-4ad9-8bcb-2ea53ce8c2a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd4e7a-aa87-4bbc-9343-3beb417b888c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b283a116-d0d2-4493-9dc6-0216f4829a69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[52821385-e38a-4f9d-b5f8-237faf246dc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:29:32 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a43fc5-5fe8-41ff-a2e2-a9a9d9b3fa0b]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG os_brick.utils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating existing volume attachment record: 68b319bc-4eb3-490d-b2d5-d35d3ab76417 {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:29:32 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:29:33 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:29:33 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:29:33 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:29:33 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:35 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:36 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:29:36 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:29:36 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.173694610595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:29:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUCagNpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:29:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:29:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:29:39 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[913bbadf-cfe0-4d80-b232-2bc7e198eb25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:29:39 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[746af0f4-999b-4ab7-aa93-bf9741e0605d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f] added
Aug 03 00:29:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bfc389-9c63-4bb3-b09c-514b3ad99c1b]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[25458e79-8c4a-4dc2-8151-eb466371e6a3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUCagNpM {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUCagNpM" returned: 0 in 0.025s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b1635-f2f9-494e-a44a-71bf3c14ad5f]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUCagNpM'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[862a8184-9400-4aff-b3ee-59afd89628f3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[321aad06-8f2c-4c1f-9d99-7c43f3e45f93]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:29:39 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:29:39 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:29:39 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:29:39 user nova-compute[72520]: 
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f295c511-b611-4905-a1b4-544517b6e543]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260]
Aug 03 00:29:39 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260] successful.
Aug 03 00:29:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d354ef-049f-4902-b6a4-bc1af7bc2164]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca5f391-5786-42f8-b782-e7804eff240c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f (non-flash)
Aug 03 00:29:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f (non-flash)
Aug 03 00:29:39 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8349942b-f1f8-468f-bb01-920dc2d32644]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUCagNpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:29:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:29:40 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26262326336363636', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:29:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262326336363636', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:29:40 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:29:40 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:29:40 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:29:40 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:29:40 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:29:40 user nova-compute[72520]:   <serial>c294a3eb-5d8c-4e90-99c1-a3e811136a0f</serial>
Aug 03 00:29:40 user nova-compute[72520]: </disk>
Aug 03 00:29:40 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:29:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:29:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:29:41 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No VIF found with MAC fa:16:3e:6b:96:b5, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:29:41 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d6a6c8d5-4882-4ef5-901b-0cbda5ccbf05 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.231s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:29:43 user nova-compute[72520]: INFO nova.compute.manager [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Detaching volume c294a3eb-5d8c-4e90-99c1-a3e811136a0f
Aug 03 00:29:43 user nova-compute[72520]: INFO nova.virt.block_device [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attempting to driver detach volume c294a3eb-5d8c-4e90-99c1-a3e811136a0f from mountpoint /dev/vdb
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Attempting to detach device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:29:43 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:29:43 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:29:43 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:29:43 user nova-compute[72520]:   <serial>c294a3eb-5d8c-4e90-99c1-a3e811136a0f</serial>
Aug 03 00:29:43 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:29:43 user nova-compute[72520]: </disk>
Aug 03 00:29:43 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:29:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config.
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:29:43 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:29:43 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:29:43 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:29:43 user nova-compute[72520]:   <serial>c294a3eb-5d8c-4e90-99c1-a3e811136a0f</serial>
Aug 03 00:29:43 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:29:43 user nova-compute[72520]: </disk>
Aug 03 00:29:43 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691022583.9478, 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:29:43 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config.
Aug 03 00:29:43 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUCagNpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:29:43 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:29:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b897e54-68e4-4f09-b6be-60cb90dec722]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:43 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0664b26-72e9-41cd-9a04-e9678bd4e48d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f (non-flash)
Aug 03 00:29:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f (non-flash)
Aug 03 00:29:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7cc467b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c93c4-dd55-41d4-bc3c-c83efebc4320]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07293345-43c0-4c07-8e67-8d7aaf4d8f95]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e223cac9-9adc-4ad6-8085-ab0401d6cdc6]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[977991a8-b135-418f-aefb-63fae652e7cb]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed0306b-212b-4290-ac43-a4763ef900f3]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c892ac0-18e9-42a4-a973-03a5350911f2]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260]
Aug 03 00:29:44 user nova-compute[72520]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f, portal: 172.16.0.220,3260] successful.
Aug 03 00:29:44 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c294a3eb-5d8c-4e90-99c1-a3e811136a0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e5c5c-0875-4094-b84c-fffa35b5a2d0]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== disconnect_volume: return (245ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG nova.objects.instance [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:44 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-d92b8163-5835-4aa7-a32e-5cb4be51936a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.513s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:29:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:29:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:29:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:30:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:30:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:30:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:30:29 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:30:37 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:30:38 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:30:38 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.172672271728516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.376s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:30:38 user nova-compute[72520]: INFO nova.compute.manager [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attaching volume f780d58e-1d56-4ba5-8a16-403affab207e to /dev/vdb
Aug 03 00:30:38 user nova-compute[72520]: DEBUG os_brick.utils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5f25d7-8497-41fb-9bb1-351749e79838]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6a574eb0a0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c707e99-e47e-429e-b7d6-0dfa9c1357f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1e5632-08df-4773-85bd-0030a5aa78d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[749098b0-0ea4-4648-84c7-f77443eb3f70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Running cmd (subprocess): nvme version {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] 'nvme version' failed. Not Retrying. {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] nvme not present on system {{(pid=72520) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 00:30:38 user nova-compute[72520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dca664-5e7d-48fa-ab72-ea5ef98c4e10]: (4, '') {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72520) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.lightos [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] LIGHTOS: no hostnqn found. {{(pid=72520) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG os_brick.utils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6a574eb0a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.virt.block_device [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating existing volume attachment record: 65cab988-6e71-4df9-91bd-de7dc2c164eb {{(pid=72520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:30:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:30:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:41 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:44 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:30:44 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:30:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Calling os-brick to attach iSCSI Volume {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeSMTDZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:30:45 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:30:45 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:30:45 user nova-compute[72520]: INFO os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eedf91-9890-420f-8f67-b1c1692e8e19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 00:30:45 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --interface default --op new {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ec455-23f0-473f-a2a7-b142323014bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e] added\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e] added
Aug 03 00:30:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac92cf9-b861-40e2-bcaf-a5e3f9d5774d]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0d922e-bdbb-4d72-89d2-e51058bd7372]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeSMTDZc {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeSMTDZc" returned: 0 in 0.021s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f56953-cc94-49a0-9184-de048d35c06e]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jeSMTDZc'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac21dc7-970a-40c4-8b6e-f6be804e5622]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d512ac3-26a9-4beb-a0b9-e6229b677ed5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:30:45 user nova-compute[72520]:  {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 00:30:45 user nova-compute[72520]:  {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:30:45 user nova-compute[72520]: WARNING os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 00:30:45 user nova-compute[72520]: 
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --login {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0f4c42-aa2d-4f80-8a56-d8cfa6034eb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260]
Aug 03 00:30:45 user nova-compute[72520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260] successful.
Aug 03 00:30:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef0e387-05da-40bc-ab38-f536c059e740]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a22d2f-bea4-4ea1-a913-f5b17f3253fa]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e (non-flash)
Aug 03 00:30:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e (non-flash)
Aug 03 00:30:45 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to 172.16.0.220:3260 {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72520) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72520) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0410be-0b11-41b3-8ca6-4ec11a20e7ff]: (4, ('- - 0', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72520) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 00:30:45 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeSMTDZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72520) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 00:30:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:30:46 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23330383530623837', 'path': '/dev/sdb'} {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:30:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330383530623837', 'path': '/dev/sdb'} {{(pid=72520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 00:30:46 user nova-compute[72520]: DEBUG nova.objects.instance [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:30:46 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 00:30:46 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:30:46 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:30:46 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:30:46 user nova-compute[72520]:   <serial>f780d58e-1d56-4ba5-8a16-403affab207e</serial>
Aug 03 00:30:46 user nova-compute[72520]: </disk>
Aug 03 00:30:46 user nova-compute[72520]:  {{(pid=72520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 00:30:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vda, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:30:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 00:30:47 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] No VIF found with MAC fa:16:3e:6b:96:b5, not building metadata {{(pid=72520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 00:30:47 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-2cebae50-d2b5-4c37-a86f-d6833a521937 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.119s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:30:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:30:49 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:30:49 user nova-compute[72520]: INFO nova.compute.manager [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Detaching volume f780d58e-1d56-4ba5-8a16-403affab207e
Aug 03 00:30:49 user nova-compute[72520]: INFO nova.virt.block_device [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Attempting to driver detach volume f780d58e-1d56-4ba5-8a16-403affab207e from mountpoint /dev/vdb
Aug 03 00:30:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Attempting to detach device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config. {{(pid=72520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 00:30:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:30:49 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:30:49 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:30:49 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:30:49 user nova-compute[72520]:   <serial>f780d58e-1d56-4ba5-8a16-403affab207e</serial>
Aug 03 00:30:49 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:30:49 user nova-compute[72520]: </disk>
Aug 03 00:30:49 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:30:49 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the persistent domain config.
Aug 03 00:30:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config. {{(pid=72520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 00:30:49 user nova-compute[72520]: DEBUG nova.virt.libvirt.guest [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 00:30:49 user nova-compute[72520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 00:30:49 user nova-compute[72520]:   <source dev="/dev/sdb"/>
Aug 03 00:30:49 user nova-compute[72520]:   <target dev="vdb" bus="virtio"/>
Aug 03 00:30:49 user nova-compute[72520]:   <serial>f780d58e-1d56-4ba5-8a16-403affab207e</serial>
Aug 03 00:30:49 user nova-compute[72520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 00:30:49 user nova-compute[72520]: </disk>
Aug 03 00:30:49 user nova-compute[72520]:  {{(pid=72520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 00:30:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-d0fef0d8-ba88-4e8f-abaf-15c29829d110 None None] Received event <DeviceRemovedEvent: 1691022650.2376904, 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.driver [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 00:30:50 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully detached device vdb from instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 from the live domain config.
Aug 03 00:30:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] calling os-brick to detach iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7cfc1d6650>, {'target_iqns': ['iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeSMTDZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 00:30:50 user nova-compute[72520]: WARNING os_brick.initiator.connectors.base [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e', 0)] {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91cd07c-4d62-4c58-ad93-316166f50407]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[525cdaa6-9055-4dbb-97ef-a164696568a3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e (non-flash)\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e (non-flash)
Aug 03 00:30:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e (non-flash)
Aug 03 00:30:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d0a62d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e'): ({'sdb'}, set())}) {{(pid=72520) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Removing single pathed devices sdb {{(pid=72520) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e53da91-9bc5-434f-9faa-d4340dbc7057]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e44be89-b106-460d-b70a-ebd0fb790d5c]: (4, ('ok\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Flushing IO for device /dev/sdb {{(pid=72520) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2646d1ac-e6c1-407b-93a0-035a271ecc64]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72520) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db7e8ea-32c1-4540-90ca-911c368a49d2]: (4, ('1', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.linuxscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] SCSI volumes sdb have been removed. {{(pid=72520) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e')] {{(pid=72520) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b8b8f-8c46-4808-8b26-e6b98d215361]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --logout {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bacc38-1247-4b0d-9a37-0a542f38062f]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260]
Aug 03 00:30:50 user nova-compute[72520]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e, portal: 172.16.0.220,3260] successful.
Aug 03 00:30:50 user nova-compute[72520]:  stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op delete {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f780d58e-1d56-4ba5-8a16-403affab207e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83015) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG oslo.privsep.daemon [-] privsep: reply[69378875-f15a-45f1-8724-7cea21066341]: (4, ('', '')) {{(pid=83015) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72520) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.base [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] <== disconnect_volume: return (262ms) None {{(pid=72520) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 00:30:50 user nova-compute[72520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Disconnected iSCSI Volume {{(pid=72520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 00:30:51 user nova-compute[72520]: DEBUG nova.objects.instance [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'flavor' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:30:51 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-f90ae8fc-8c94-4daa-b3d8-50cd1134e4b7 tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.589s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:30:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:30:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:14 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:19 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:24 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:29 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:30 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:34 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:31:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:31:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:31:34 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquired lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Forcefully refreshing network info cache for instance {{(pid=72520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG nova.objects.instance [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lazy-loading 'info_cache' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG nova.network.neutron [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [{"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Releasing lock "refresh_cache-22b8e2a6-590c-4443-b51e-ba8958a9dfd7" {{(pid=72520) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updated the network info_cache for instance {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 00:31:36 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 00:31:38 user nova-compute[72520]: DEBUG oslo_concurrency.processutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72520) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 00:31:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:31:39 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:31:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.171749114990234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:31:39 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:42 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:44 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:31:46 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:46 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:31:49 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:31:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:31:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:31:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:31:54 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:31:59 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:32:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:32:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:32:04 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:32:09 user nova-compute[72520]: INFO nova.compute.manager [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Terminating instance
Aug 03 00:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Start destroying the instance on the hypervisor. {{(pid=72520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-0880751a-1356-497f-b67a-765f596228c5 req-e6ecea6a-6ded-41bc-af5d-c3cca5e30fc1 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-vif-unplugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0880751a-1356-497f-b67a-765f596228c5 req-e6ecea6a-6ded-41bc-af5d-c3cca5e30fc1 service nova] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0880751a-1356-497f-b67a-765f596228c5 req-e6ecea6a-6ded-41bc-af5d-c3cca5e30fc1 service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-0880751a-1356-497f-b67a-765f596228c5 req-e6ecea6a-6ded-41bc-af5d-c3cca5e30fc1 service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-0880751a-1356-497f-b67a-765f596228c5 req-e6ecea6a-6ded-41bc-af5d-c3cca5e30fc1 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] No waiting events found dispatching network-vif-unplugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:32:09 user nova-compute[72520]: DEBUG nova.compute.manager [req-0880751a-1356-497f-b67a-765f596228c5 req-e6ecea6a-6ded-41bc-af5d-c3cca5e30fc1 service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-vif-unplugged-e8335ea8-52b6-4513-9b65-8228034156c4 for instance with task_state deleting. {{(pid=72520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [-] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Instance destroyed successfully.
Aug 03 00:32:10 user nova-compute[72520]: DEBUG nova.objects.instance [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lazy-loading 'resources' on Instance uuid 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 {{(pid=72520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG nova.virt.libvirt.vif [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T00:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-701203765',display_name='tempest-SnapshotDataIntegrityTests-server-701203765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-701203765',id=52,image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyo5P6Vir1mceGl+iXqNxBKRP46lFnB4XiLbsY5JZ2Sj+N8ITBE3QdSaJD+g9Dpaz0duwycOUEX4aC4syXjTIvL8d4vNgWdvnw0ZyAOzuPnvokCk+vkRbxND9nnQCKoyg==',key_name='tempest-keypair-1031433737',keypairs=<?>,launch_index=0,launched_at=2023-08-03T00:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8fcd7fc11344b96a8ea5fe4447818f3',ramdisk_id='',reservation_id='r-mrpmcno0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf7ff550-99bb-492f-8b9b-e7b427d12188',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-241679260',owner_user_name='tempest-SnapshotDataIntegrityTests-241679260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T00:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f14b402fa25447279bf7b15edb2cb9f9',uuid=22b8e2a6-590c-4443-b51e-ba8958a9dfd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Converting VIF {"id": "e8335ea8-52b6-4513-9b65-8228034156c4", "address": "fa:16:3e:6b:96:b5", "network": {"id": "c1817d99-d12f-4519-80b6-4bfe72329af0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-871330695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8fcd7fc11344b96a8ea5fe4447818f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8335ea8-52", "ovs_interfaceid": "e8335ea8-52b6-4513-9b65-8228034156c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG nova.network.os_vif_util [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:96:b5,bridge_name='br-int',has_traffic_filtering=True,id=e8335ea8-52b6-4513-9b65-8228034156c4,network=Network(c1817d99-d12f-4519-80b6-4bfe72329af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8335ea8-52') {{(pid=72520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG os_vif [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:96:b5,bridge_name='br-int',has_traffic_filtering=True,id=e8335ea8-52b6-4513-9b65-8228034156c4,network=Network(c1817d99-d12f-4519-80b6-4bfe72329af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8335ea8-52') {{(pid=72520) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8335ea8-52, bridge=br-int, if_exists=True) {{(pid=72520) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:10 user nova-compute[72520]: INFO os_vif [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:96:b5,bridge_name='br-int',has_traffic_filtering=True,id=e8335ea8-52b6-4513-9b65-8228034156c4,network=Network(c1817d99-d12f-4519-80b6-4bfe72329af0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8335ea8-52')
Aug 03 00:32:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Deleting instance files /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7_del
Aug 03 00:32:10 user nova-compute[72520]: INFO nova.virt.libvirt.driver [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Deletion of /opt/stack/data/nova/instances/22b8e2a6-590c-4443-b51e-ba8958a9dfd7_del complete
Aug 03 00:32:10 user nova-compute[72520]: INFO nova.compute.manager [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 03 00:32:10 user nova-compute[72520]: DEBUG oslo.service.loopingcall [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72520) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG nova.compute.manager [-] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Deallocating network for instance {{(pid=72520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 00:32:10 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] deallocate_for_instance() {{(pid=72520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 00:32:11 user nova-compute[72520]: DEBUG nova.network.neutron [-] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Updating instance_info_cache with network_info: [] {{(pid=72520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 00:32:11 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Took 0.88 seconds to deallocate network for instance.
Aug 03 00:32:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:32:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:32:11 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:32:11 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:32:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:32:11 user nova-compute[72520]: INFO nova.scheduler.client.report [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Deleted allocations for instance 22b8e2a6-590c-4443-b51e-ba8958a9dfd7
Aug 03 00:32:11 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-bf355ca2-df75-45a3-bd9a-d18e9ddc184a tempest-SnapshotDataIntegrityTests-241679260 tempest-SnapshotDataIntegrityTests-241679260-project-member] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.067s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:32:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-b3de6a1b-8a36-4304-9259-6757a36c30a8 req-b41ef5d6-bef6-4857-a0dd-dc558c3f15af service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:32:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b3de6a1b-8a36-4304-9259-6757a36c30a8 req-b41ef5d6-bef6-4857-a0dd-dc558c3f15af service nova] Acquiring lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:32:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b3de6a1b-8a36-4304-9259-6757a36c30a8 req-b41ef5d6-bef6-4857-a0dd-dc558c3f15af service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:32:12 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [req-b3de6a1b-8a36-4304-9259-6757a36c30a8 req-b41ef5d6-bef6-4857-a0dd-dc558c3f15af service nova] Lock "22b8e2a6-590c-4443-b51e-ba8958a9dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:32:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-b3de6a1b-8a36-4304-9259-6757a36c30a8 req-b41ef5d6-bef6-4857-a0dd-dc558c3f15af service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] No waiting events found dispatching network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 00:32:12 user nova-compute[72520]: WARNING nova.compute.manager [req-b3de6a1b-8a36-4304-9259-6757a36c30a8 req-b41ef5d6-bef6-4857-a0dd-dc558c3f15af service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received unexpected event network-vif-plugged-e8335ea8-52b6-4513-9b65-8228034156c4 for instance with vm_state deleted and task_state None.
Aug 03 00:32:12 user nova-compute[72520]: DEBUG nova.compute.manager [req-b3de6a1b-8a36-4304-9259-6757a36c30a8 req-b41ef5d6-bef6-4857-a0dd-dc558c3f15af service nova] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Received event network-vif-deleted-e8335ea8-52b6-4513-9b65-8228034156c4 {{(pid=72520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 00:32:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:25 user nova-compute[72520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691022730.3261302, 22b8e2a6-590c-4443-b51e-ba8958a9dfd7 => Stopped> {{(pid=72520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 00:32:25 user nova-compute[72520]: INFO nova.compute.manager [-] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] VM Stopped (Lifecycle Event)
Aug 03 00:32:25 user nova-compute[72520]: DEBUG nova.compute.manager [None req-65662e9d-1537-4f19-83ec-895d2284896a None None] [instance: 22b8e2a6-590c-4443-b51e-ba8958a9dfd7] Checking state {{(pid=72520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 00:32:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:30 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:32 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:35 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:35 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Starting heal instance info cache {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Rebuilding the list of instances to heal {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Didn't find any instances for network info cache update. {{(pid=72520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 00:32:38 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:32:38 user nova-compute[72520]: WARNING nova.virt.libvirt.driver [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=25.198867797851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.compute.provider_tree [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed in ProviderTree for provider: 34a01f3b-1fb2-4503-8766-a057bea6ed6a {{(pid=72520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 00:32:38 user nova-compute[72520]: DEBUG nova.scheduler.client.report [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Inventory has not changed for provider 34a01f3b-1fb2-4503-8766-a057bea6ed6a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 00:32:39 user nova-compute[72520]: DEBUG nova.compute.resource_tracker [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Compute_service record updated for user:user {{(pid=72520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 00:32:39 user nova-compute[72520]: DEBUG oslo_concurrency.lockutils [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72520) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 00:32:40 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:43 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:32:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72520) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 00:32:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:32:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72520) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 00:32:45 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:48 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 00:32:48 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:50 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:32:50 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 00:32:50 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] There are 0 instances to clean {{(pid=72520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 00:32:54 user nova-compute[72520]: DEBUG oslo_service.periodic_task [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72520) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 00:32:54 user nova-compute[72520]: DEBUG nova.compute.manager [None req-5b76d4f3-151b-4cc7-a724-8f3557c0e4c6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 00:32:55 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:33:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:33:00 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:33:03 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:33:05 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:33:06 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:33:10 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:33:15 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 00:33:20 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 00:33:25 user nova-compute[72520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72520) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}